-- Logs begin at Wed 2022-08-03 11:29:41 UTC, end at Wed 2022-08-03 12:32:12 UTC. -- Aug 03 12:01:58.779902 dv-cinder-836027-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 12:01:58.789424 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 12:01:58 2022] *** Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: nodename: dv-cinder-836027-3-iscsi Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: machine: x86_64 Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: clock source: unix Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: pcre jit disabled Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: detected number of CPU cores: 4 Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: current working directory: / Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: detected binary path: /usr/bin/uwsgi-core Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: your processes number limit is 47680 Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: your memory page size is 4096 bytes Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: detected max file descriptor number: 2048 Aug 03 12:01:58.791582 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: lock engine: pthread robust mutexes Aug 03 12:01:58.792838 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: thunder lock: enabled Aug 03 12:01:58.792838 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 12:01:58.792838 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 12:01:58.831413 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: Python main interpreter initialized at 0x556addd219c0 Aug 03 12:01:58.831413 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: python threads support enabled Aug 03 12:01:58.831413 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: your server socket listen backlog is limited to 100 connections Aug 03 12:01:58.831413 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: your mercy for graceful operations on workers is 90 seconds Aug 03 12:01:58.831836 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 12:01:58.831836 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: *** Operational MODE: preforking *** Aug 03 12:01:58.832146 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: *** uWSGI is running in multiple interpreter mode *** Aug 03 12:01:58.832146 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: spawned uWSGI master process (pid: 103380) Aug 03 12:01:58.832362 dv-cinder-836027-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 12:01:58.837780 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: spawned uWSGI worker 1 (pid: 103381, cores: 1) Aug 03 12:01:58.837780 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: spawned uWSGI worker 2 (pid: 103382, cores: 1) Aug 03 12:01:58.837780 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 12:01:59.497820 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 12:01:59.514938 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 12:02:00.630753 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:02:00.630753 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: from cryptography.utils import int_from_bytes Aug 03 12:02:00.631770 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:02:00.631770 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: from cryptography.utils import int_from_bytes Aug 03 12:02:00.725754 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:02:00.725754 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: from cryptography.utils import int_from_bytes Aug 03 12:02:00.726664 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:02:00.726664 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: from cryptography.utils import int_from_bytes Aug 03 12:02:03.182005 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:02:03.182796 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:02:03.182796 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:02:03.183204 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:02:03.183417 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:02:03.183804 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.183959 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:02:03.184386 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.184502 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:02:03.184631 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.184729 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.184806 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:02:03.185027 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.185137 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:02:03.185335 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.185453 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:02:03.185652 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.185758 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.185965 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.186064 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.186288 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.186379 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.186566 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.186673 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.186882 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.186997 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.187205 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-3-iscsi {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.187310 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.187523 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.187652 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.187824 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.187919 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.188129 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.188242 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.188444 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.188574 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.188749 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.188863 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.189064 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.189158 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-3-iscsi {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.189363 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.189463 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.189684 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.189861 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.190062 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.190333 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.190487 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.191605 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.191807 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.191915 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.192036 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.192036 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.192219 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.192219 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.192496 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.192645 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.192775 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.192896 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.193027 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.193171 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.193283 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.193402 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.193527 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.193664 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.193819 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.193942 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-3-iscsi {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.194131 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.194283 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.194375 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.194553 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.194661 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.194821 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.194930 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.194930 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.195143 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.195143 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.195362 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-3-iscsi {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.195454 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.195530 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.195748 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.195838 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.196088 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.196259 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.196397 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.196545 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.196681 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.196845 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.196977 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.197120 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.197299 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.197429 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.197612 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.197710 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.197911 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.198001 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.198216 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.198320 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.198546 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.198655 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.198864 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.198951 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.199171 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.199297 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.199469 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.199574 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.199713 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.199850 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.200083 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.200217 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.200382 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.200524 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.200658 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.200744 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.201030 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.201172 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.201325 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.201415 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.201548 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.201632 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.201745 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.201887 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.202028 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.202185 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.202306 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.202534 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.202645 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.202797 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.202927 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.203040 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.203217 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.203317 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.203520 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.203644 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.203821 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.203935 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.204129 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.204296 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.204453 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.204590 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.204717 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.204847 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.205025 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.205126 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.205337 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.205426 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.205637 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.205726 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.205985 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.206085 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.206328 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.206422 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.206674 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.206853 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.206989 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.207137 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.207305 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.207423 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.207612 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.207708 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.207917 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.208085 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.208236 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.208338 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.208547 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.208632 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.208849 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.208950 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.209220 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.209372 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.209471 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.209551 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.209737 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.209889 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.210074 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.210232 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.210382 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.210789 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.210951 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.211090 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.211241 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.211341 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.211410 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.211554 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.211649 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.211749 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.211856 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.211949 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.212077 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.212176 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.212373 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.212469 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.212669 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.212760 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.212978 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.213083 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.213358 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.213492 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.213609 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.213714 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.213872 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.214001 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.214170 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.214377 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.214545 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.214706 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.214860 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.215030 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.215157 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.215262 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.215375 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.215490 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.215669 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.215820 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.215985 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.216074 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.216286 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.216377 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.216586 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.216684 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.216900 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.217079 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.217274 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.217426 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.217597 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.217762 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.217910 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.218057 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.218205 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.218351 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.218535 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.218700 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.218843 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.219001 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.219146 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.219294 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.219432 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.219590 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.219738 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.219883 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.220031 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.220173 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.220365 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.220528 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.220681 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.220816 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.220952 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.221091 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.221249 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.221892 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.221988 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.222096 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.222220 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.222339 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.222593 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.222724 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.222849 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.222971 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.223094 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.223238 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.223381 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.223520 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.223646 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.223769 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.223890 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.224056 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.224705 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.224842 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.225123 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.225341 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.225579 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.225808 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.226024 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.226248 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.226546 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.226783 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.227037 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.227409 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.227644 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.227880 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.228047 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.228195 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.228336 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.228496 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.228651 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.228761 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.228761 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.228977 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.229113 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:02:03.229270 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.229270 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.229270 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.229270 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.229767 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.229926 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.230070 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.230213 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.230421 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.230621 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.230713 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.230804 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.230965 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.231118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.231274 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.231375 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.231455 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.231612 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.231753 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.231857 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.231980 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.232130 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.232287 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.232430 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.232581 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.232879 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.233097 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.233246 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.233391 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.233550 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.233688 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.233830 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.233974 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.234115 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.234268 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.234425 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.234631 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.234774 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.234917 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.235059 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.235218 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.235373 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.235539 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.235667 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.235793 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.235932 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.236092 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.236235 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.236380 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.236542 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.236686 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.236844 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.236844 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.237857 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.238009 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.238156 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.238310 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.238492 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.238658 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.238801 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.238957 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.239112 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.239257 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.239417 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.239572 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.239712 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.239850 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.240001 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.240141 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.240297 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.240517 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.240664 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.240810 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.240951 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.241154 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.241324 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.241476 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.241621 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.241759 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.241900 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.242052 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.242211 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.242357 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.242534 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.242676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.242817 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.242980 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.243122 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.243322 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.243465 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.243610 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.243750 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.243905 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.244056 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.244211 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.244355 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.244512 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.244657 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.244817 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.244968 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.245112 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.245253 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.245403 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.245549 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.245762 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.245957 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.246106 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.246252 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.246385 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.246578 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.246729 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.246932 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.247059 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.247059 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.247261 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.247355 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.247492 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.247583 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.247709 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.247808 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.247889 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.248112 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.248228 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.248314 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.248441 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.248524 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.248657 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.248750 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.248877 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.248973 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.249114 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.249255 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.249418 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.249562 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.249706 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.249852 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.249995 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.250146 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.250304 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.250482 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.250650 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.250794 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.250932 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.251081 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.251237 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.251379 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.251520 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.251664 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.251808 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.251948 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.252103 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.252256 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.252399 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.252528 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.252681 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.252813 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.252925 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.253018 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.253117 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.253258 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.253430 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.253592 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.253734 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.253888 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.254030 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.254171 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.254316 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.254568 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.254716 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.254863 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.255009 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.255150 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.255307 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.255466 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.255466 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.255691 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.255772 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.255848 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.255927 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.256050 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.256184 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.256327 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.256427 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.256508 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.256718 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.256882 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.257034 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.257178 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.257333 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.257476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.257752 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.257911 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.258058 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.258284 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.258284 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.258558 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.258727 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.258869 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.259021 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.259154 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.259291 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.259445 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.259594 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.259735 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.259889 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.260030 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.260175 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.260332 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.260477 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.260601 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.260723 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.260867 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.261006 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.261205 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.261406 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.261557 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.261557 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.261821 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.261963 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.262126 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.262615 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.262761 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.262922 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.263032 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.263186 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.263346 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.263502 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.263710 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.263857 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.264002 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.264165 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.264322 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.264464 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.264609 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.264740 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.264827 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.264917 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.264999 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.265149 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.265293 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.265437 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.265580 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.265756 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.265903 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.266113 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.266237 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.266369 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.266533 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.266684 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.266846 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.266992 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.267135 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.267282 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.267449 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.267595 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.267740 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.267886 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.268028 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.268209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.268427 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.268537 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.268625 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.268766 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.268907 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.269050 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.269215 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.269360 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.269499 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.269657 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.269805 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.269906 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.270077 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.270204 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.270399 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.270556 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.270737 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.270830 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.271061 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.271214 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.271379 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.271554 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.271707 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.271867 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.272003 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.272103 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.272273 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.272416 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.272571 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.272741 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.272872 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.273012 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.273187 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.273337 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.273482 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.273637 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.273768 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.273922 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.274069 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.274225 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.274371 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.274563 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.274721 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.274881 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.275008 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.275099 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.275309 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.275484 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.275632 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.275780 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.275924 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.276066 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.276207 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.276348 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.276554 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.276679 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.276775 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.276844 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.277047 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.277200 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.277355 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.277512 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.277660 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.277807 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.277950 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.278096 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.278225 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.278373 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.278602 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.278761 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.278904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.279047 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.279189 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.279343 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.279488 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.279648 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.279791 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.279932 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.280076 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.280220 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.280366 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.280525 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.280665 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.280837 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.280994 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.281141 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.281273 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.281373 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.281477 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.281635 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.281779 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.281923 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.282089 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.282232 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.282374 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.282602 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.282725 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.282873 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.282978 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.283189 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.283455 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.283614 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.283760 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.284423 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.284567 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.284708 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.284849 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.284989 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.285129 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.285272 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.285431 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.285575 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.285718 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.285861 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.286019 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.286270 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.286415 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.286736 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.286902 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.287047 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.287188 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.287351 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.287495 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.287650 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.287792 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.287942 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.288095 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.288254 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.288397 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.288539 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.288757 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.288902 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.289032 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.289135 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.289226 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.289314 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.289413 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.289489 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.289726 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.289875 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.290030 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.290315 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.290646 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.290802 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.290945 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.291088 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.291261 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.291421 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.291556 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.291709 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.291882 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.292049 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.292195 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.292351 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.292489 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.292630 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.292770 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.292933 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.292933 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.293210 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.293378 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.293534 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.293689 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.293830 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.293984 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.294126 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.294265 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.294408 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.294733 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.294880 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.295045 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.295188 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.295327 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.295468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.295611 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.295777 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.295897 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.295979 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.296132 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.296281 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.296420 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.296558 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.296771 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.296920 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.297064 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.297203 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.297203 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.297491 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.297491 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.297674 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.297758 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.297871 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.298000 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.298159 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.298302 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.298468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.298611 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.298753 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.298882 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.299029 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.299174 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.299330 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.299549 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.300199 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.300358 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.300501 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.300644 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.300798 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.300941 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.301160 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.301322 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.301467 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.301609 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.301755 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.301930 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.302092 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.302251 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.302405 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.302568 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.302727 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.302869 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.303012 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.303167 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.303311 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.303453 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.303577 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.303662 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.303812 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.303957 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.304100 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.304238 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.304397 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.304541 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.304695 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.304822 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.304951 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.305107 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.305269 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.305414 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.305573 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.305720 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.305864 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.306006 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.306143 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.306270 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.306431 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.306651 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.306820 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.306963 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.307086 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.307253 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.307397 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.307544 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.307686 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.307831 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.307972 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.308136 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.308278 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.308421 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.308566 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.308708 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.308848 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.308990 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.309147 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.309292 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.309419 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.309558 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.309703 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.309978 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.310126 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.310281 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.310532 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.310687 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.310851 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.311005 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.311160 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.311315 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.311415 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.311492 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.311582 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.311715 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.311802 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.311869 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.311942 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.312111 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.312226 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.312426 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.312561 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.312730 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.312878 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.313023 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.313179 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.313317 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.313413 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.313626 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.313779 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.313936 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.314089 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.314233 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.314388 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.314582 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.314731 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.314895 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.315061 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.315195 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.315340 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.315483 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.315638 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.315797 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.315943 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.316106 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.316263 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.316404 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.316561 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.316725 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.316863 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.316990 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.317203 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.317360 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.317517 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.317681 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.317825 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.317968 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.318107 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.318197 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.318280 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.318401 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.318564 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.318727 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.318884 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.319025 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.319173 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.319338 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.319486 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.319623 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.319767 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.319936 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.320094 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.320235 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.320372 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.320554 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.320709 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.320870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.321022 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.321167 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.321297 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.321442 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.321586 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.321752 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.321914 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.322057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.322176 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.322295 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.322478 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.322700 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.322848 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.323005 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.323145 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.323300 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.323435 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.323609 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.323753 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.323907 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.324061 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.324209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.324364 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.324529 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.324678 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.324825 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.324971 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.325102 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.325243 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.325390 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.325530 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.325686 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.325828 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.325972 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.326135 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.326288 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.326429 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.326590 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.326733 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.326880 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.327037 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.327188 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.327321 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.327453 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.327584 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.327829 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.328001 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.328150 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.328299 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.328439 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.328595 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.328753 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.328916 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.329061 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.329216 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.329341 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.329501 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.329642 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.329785 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.329926 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.330062 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.330195 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.330326 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.330642 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.330816 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.330957 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.331098 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.331240 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.331445 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.331616 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.331757 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.331757 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.332036 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.332181 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.332321 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.332413 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.332535 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.332659 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.332800 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.332942 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.333106 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.333262 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.333416 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.333562 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.333704 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.333845 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.334001 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.334147 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.334295 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.334385 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.334644 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.334823 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.334960 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.335122 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.335358 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.335524 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.335673 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.335836 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.335979 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.336119 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.336262 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.336404 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.336547 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.336717 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.336862 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.337003 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.337159 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.337309 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.337490 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.337732 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.337876 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.338017 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.338159 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.338301 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.338491 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.338657 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.338805 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.338963 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.339120 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.339277 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.339493 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.339647 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.339793 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.339921 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.340070 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.340250 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.340408 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.340550 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.340704 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.340848 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.340990 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.341132 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.341275 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.341432 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.341590 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.341732 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.341874 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.342029 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.342191 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.342309 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.342519 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.342666 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.342803 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.342947 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.343094 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.343239 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.343402 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.343546 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.343690 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.343831 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.343973 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.344132 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.344279 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.344454 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.344602 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.344758 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.344905 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.345064 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.345208 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.345387 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.345527 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.345671 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.345826 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.345985 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.346142 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.346822 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.347080 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.347223 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.347415 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.347591 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.347748 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.347902 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.348051 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.348198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.348464 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.348609 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.348757 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.348878 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.349003 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.349150 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.349309 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.349445 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.349569 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.349693 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.349835 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.349981 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.350140 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.350283 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.350424 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.350600 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.350747 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.350891 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.351055 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.351201 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.351345 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.351500 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.351629 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.351785 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.351931 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.352076 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.352200 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.352344 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.352489 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.352648 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.352799 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.352946 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.353091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.353233 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.353388 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.353549 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.353695 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.353837 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.353965 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.354054 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.354267 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.354435 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.354612 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.354776 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.354931 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.355075 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.355218 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.355322 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.355453 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.355593 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.355733 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.355912 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.356142 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.356288 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.356426 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.356568 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.356710 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.356851 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.357007 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.357201 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.357351 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.357482 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.357611 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.357751 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.357895 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.358025 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.358166 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.358339 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.358521 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.358683 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.358775 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.358938 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.359027 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.359260 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.359393 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.359568 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.359703 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.359883 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.359974 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.360201 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.360364 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.360521 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.360663 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.360786 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.360925 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.361094 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.361256 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.361401 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.361521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.361758 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.361911 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.362107 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.362271 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.362415 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.362689 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.362855 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.362999 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.363234 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.363396 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.363602 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.363778 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.363926 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.364204 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.364356 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.364551 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.364856 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.365184 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.365309 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.365495 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.365823 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.365938 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.366143 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.366520 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.366614 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.366790 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.367064 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.367163 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.367420 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.367677 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.367825 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.368028 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.368190 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.368334 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.368472 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.368620 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.368765 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.368911 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.369076 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.369223 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.369374 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.369526 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.369687 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.369837 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.369967 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.370124 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.370240 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.370418 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.370604 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.370756 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.370928 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.371071 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.371243 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.371386 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.371558 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.371699 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.371919 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.372062 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.372394 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.372533 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.372624 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.372707 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.372893 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.372981 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.373203 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.373291 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.373517 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.373606 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.373830 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.373918 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.374154 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.374343 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.374516 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.374673 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.374806 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.374953 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.375085 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.375249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.375383 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.375514 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.375644 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.375829 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.375966 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.376118 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.376260 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.376391 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.376776 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.377039 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.377202 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.377341 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.377505 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.378178 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.378306 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.378434 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.378829 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.378916 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.378993 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.379159 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.379271 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.379480 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.379568 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.379805 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.379990 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.380313 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.380421 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.380503 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.380572 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.381076 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.381183 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.381260 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.381328 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.381411 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.381482 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.381701 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.381785 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.382016 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.382153 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.382311 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.382476 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.382665 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.382807 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.383104 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.383245 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.383377 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.383505 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.383627 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.383847 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.383968 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.384177 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.384283 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.384500 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.384578 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.384819 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.385053 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.385141 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.385399 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.385475 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.385712 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.385788 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.388589 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.388727 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.388727 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.388873 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.388873 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.388994 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389070 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389138 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389203 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389269 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389334 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389398 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389475 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389543 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389615 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389682 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389747 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389818 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389897 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.389897 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.390035 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.390112 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.390186 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.390259 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.390334 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.390403 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.390497 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.390568 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.390634 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.390812 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.390899 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.391071 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.391190 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.391373 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.391517 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.391673 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.391828 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.391971 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.392223 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.392337 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.392451 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.392550 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.392764 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.392851 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.393071 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.393158 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.393970 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.394223 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.394323 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.394565 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.394698 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.394880 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.395001 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.395190 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.395332 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.395489 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.395577 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.395789 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.395902 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.396092 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.396268 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.396403 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.396523 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.396700 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.396867 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.396992 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.397078 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.397298 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.397384 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.397608 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.397704 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.397920 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.398018 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.398222 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.398310 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.398559 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.398734 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.398899 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.399014 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.399153 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.399269 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.399468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.399568 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.399774 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.400037 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.400195 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.400364 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.400469 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.400686 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.400789 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.400987 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.401086 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.401312 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.401411 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.401619 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.401715 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.401928 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.402032 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.402226 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.402323 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.402567 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.402659 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.402874 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.402970 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.403178 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.403268 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.403483 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.403578 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.403789 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.403884 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.404093 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.404207 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.404399 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.404691 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.404784 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.405001 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.405130 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.405306 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.405448 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.405609 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.405698 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.405911 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.406002 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.406220 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.406366 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.406544 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.406635 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.406853 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.407000 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.407159 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.407247 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.407495 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.407589 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.407807 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.407902 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.408115 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.408232 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.408428 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.408685 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.408864 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.409010 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.409167 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.409314 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.409452 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.409635 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.409763 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.409909 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.410035 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.410172 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.410287 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.410368 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.410600 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.410691 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.410862 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.410953 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.411166 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.411275 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.411471 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.411584 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.411789 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.411877 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.412139 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.412229 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.412460 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.412564 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.412777 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.412879 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.413091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.413178 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.413405 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.413490 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.413708 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.413815 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.414018 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.414103 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.414321 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.414407 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.414655 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.414766 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.414971 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.415060 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.415370 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.415600 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.415702 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.415786 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.415926 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.416102 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.416267 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.416420 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.416570 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.416733 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.416882 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.417038 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.417181 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.417313 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.417457 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.417575 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.417696 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.417868 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.418019 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.418171 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.418330 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.418611 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.418763 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.418909 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.419053 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.419216 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.419374 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.419510 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.419648 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.419770 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.419935 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.420083 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.420310 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.420507 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.420633 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.420759 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.420900 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.421051 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.421179 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.421303 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.421472 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.421575 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.421794 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.422057 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.422200 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.422345 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.422499 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.422587 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.422711 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.422817 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.422989 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.423086 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.423279 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.423434 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.423590 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.423687 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.423900 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.423987 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.424212 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.424380 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.425078 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.425162 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.425366 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.425588 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.425805 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.425874 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.425951 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.426033 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.426250 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.426337 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.426582 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.430744 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.430944 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.431098 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.431267 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.431441 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.431592 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.431745 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.431890 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.432095 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.432254 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.432398 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.432537 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.432701 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.432856 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.433009 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.433151 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.433295 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.433295 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.433580 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.433723 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.433863 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.434001 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.434137 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.434293 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.434501 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.434709 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.434884 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.435031 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.435177 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.435344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.435489 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.435635 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.435772 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.435895 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.436034 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.436184 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.436315 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.436447 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.436592 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.436738 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.436893 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.437057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.437212 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.437357 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.437511 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.437660 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.437814 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.437968 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.438122 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.438267 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.438410 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.438606 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.438765 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.438910 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.439054 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.439210 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.439352 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.439495 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.439663 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.439810 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.439954 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.440145 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.440791 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.440961 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.441172 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.441324 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.441482 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.441630 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.441772 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.442016 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.442151 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.442297 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.442468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.442612 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.442753 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.442927 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.443071 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.443210 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.443368 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.443511 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.443676 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.443822 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:02:03.443966 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.443966 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.443966 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.443966 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.443966 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.443966 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.443966 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.443966 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.444922 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.444922 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.444922 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.444922 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.444922 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.444922 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.444922 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.444922 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.445943 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:02:03.445943 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:02:03.594992 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO dbcounter [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] Registered counter for database nova_api Aug 03 12:02:03.601094 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO dbcounter [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] Registered counter for database nova_api Aug 03 12:02:03.618778 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_db.sqlalchemy.engines [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:02:03.623729 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG oslo_db.sqlalchemy.engines [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:02:03.627466 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writer thread running {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:02:03.632093 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writer thread running {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:02:03.686960 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.context [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b78e12ae-4961-43a7-b06c-67318250b51a(cell1) {{(pid=103382) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 12:02:03.688793 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.context [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b78e12ae-4961-43a7-b06c-67318250b51a(cell1) {{(pid=103381) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 12:02:03.691496 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:02:03.693133 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:02:03.693521 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:02:03.693943 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:02:03.695143 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:02:03.695967 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:02:03.696107 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:02:03.697974 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG oslo_concurrency.lockutils [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103381) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:02:03.698081 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO dbcounter [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] Registered counter for database nova_cell0 Aug 03 12:02:03.700039 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO dbcounter [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] Registered counter for database nova_cell0 Aug 03 12:02:03.703943 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO dbcounter [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] Registered counter for database nova_cell1 Aug 03 12:02:03.706303 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO dbcounter [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] Registered counter for database nova_cell1 Aug 03 12:02:03.712910 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_db.sqlalchemy.engines [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:02:03.714769 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_db.sqlalchemy.engines [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:02:03.716543 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG oslo_db.sqlalchemy.engines [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:02:03.718636 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG oslo_db.sqlalchemy.engines [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:02:03.725407 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writer thread running {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:02:03.727814 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writer thread running {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:02:03.729201 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writer thread running {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:02:03.731496 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writer thread running {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:02:03.990778 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO dbcounter [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] Registered counter for database nova_cell0 Aug 03 12:02:03.990967 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO dbcounter [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] Registered counter for database nova_cell0 Aug 03 12:02:04.002096 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG oslo_db.sqlalchemy.engines [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:02:04.006239 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_db.sqlalchemy.engines [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:02:04.008444 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writer thread running {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:02:04.011377 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writer thread running {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:02:04.355616 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: WARNING keystonemiddleware.auth_token [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:02:04.359352 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: WARNING keystonemiddleware.auth_token [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:02:04.363407 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: WARNING keystonemiddleware.auth_token [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:02:04.366938 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: WARNING keystonemiddleware.auth_token [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:02:04.713399 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: WARNING keystonemiddleware.auth_token [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:02:04.715580 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: WARNING keystonemiddleware.auth_token [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:02:04.719455 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: WARNING keystonemiddleware.auth_token [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:02:04.721663 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: WARNING keystonemiddleware.auth_token [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:02:04.724836 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556addd219c0 pid: 103381 (default app) Aug 03 12:02:04.726977 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556addd219c0 pid: 103382 (default app) Aug 03 12:02:04.727095 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:02:04.728216 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-2c70fe74-67f2-4e45-a771-9c9884e0a024 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001828 Aug 03 12:02:04.728632 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Wed Aug 3 12:02:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:03:24.509273 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:24.510768 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002306 Aug 03 12:03:24.511330 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:03:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:03:24.525223 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_api:SELECT=3 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:24.527023 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_cell0:SELECT=3 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:24.527978 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_cell1:SELECT=3 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:24.529205 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:25.473596 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-dc4bc3b7-5e57-42e3-8195-3063503226f8 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:25.504925 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-dc4bc3b7-5e57-42e3-8195-3063503226f8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.985821 Aug 03 12:03:25.506026 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Aug 3 12:03:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:03:27.759808 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:27.761197 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-3639905e-a167-492a-ae88-26b0b4d73e9b None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Aug 03 12:03:27.762975 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 2/4] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:03:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:03:28.346896 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-0475d08d-3cb3-4b64-8aed-2a7c616b2b75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "ram": 256, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:28.366881 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:03:28.366881 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: warnings.warn(msg) Aug 03 12:03:28.396562 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-0475d08d-3cb3-4b64-8aed-2a7c616b2b75 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.626052 Aug 03 12:03:28.397225 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 3/5] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Aug 3 12:03:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:03:28.414491 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writing DB stats nova_api:SELECT=3 {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:28.415627 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writing DB stats nova_cell0:SELECT=3 {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:28.416930 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writing DB stats nova_cell1:SELECT=3 {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:28.417663 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:28.632436 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-cc3decb0-b6be-4bfe-99e4-aef02daf6ae4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:28.636923 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:03:28.636923 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: warnings.warn(msg) Aug 03 12:03:28.703590 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-cc3decb0-b6be-4bfe-99e4-aef02daf6ae4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294844 Aug 03 12:03:28.704197 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 3/6] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Aug 3 12:03:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:03:31.240553 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-0475d08d-3cb3-4b64-8aed-2a7c616b2b75 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:31.241566 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-0475d08d-3cb3-4b64-8aed-2a7c616b2b75 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 03 12:03:31.242254 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 4/7] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:03:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:03:31.965274 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-c456c9b8-7bc4-4a3d-85be-0fcacb2373d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "id": "d1", "name": "ds512M"}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:31.984750 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:03:31.984750 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: warnings.warn(msg) Aug 03 12:03:32.005456 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-c456c9b8-7bc4-4a3d-85be-0fcacb2373d4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.757276 Aug 03 12:03:32.006350 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 4/8] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Aug 3 12:03:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:03:32.019103 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-f8c6d690-69c1-43a7-b1fd-b0832d2b9b61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:32.022688 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:03:32.022688 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: warnings.warn(msg) Aug 03 12:03:32.086919 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-f8c6d690-69c1-43a7-b1fd-b0832d2b9b61 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071315 Aug 03 12:03:32.088452 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 5/9] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Aug 3 12:03:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:03:34.771045 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-c456c9b8-7bc4-4a3d-85be-0fcacb2373d4 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:34.771953 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-c456c9b8-7bc4-4a3d-85be-0fcacb2373d4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 03 12:03:34.772356 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:03:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:03:35.241445 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-70ece27c-8b6c-426b-8f78-c80ed666f83d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:35.263921 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-70ece27c-8b6c-426b-8f78-c80ed666f83d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485047 Aug 03 12:03:35.264531 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 6/11] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Aug 3 12:03:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:03:35.278963 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-08fbb55c-ed9d-4104-a5f5-08833d54ecee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:35.308706 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-08fbb55c-ed9d-4104-a5f5-08833d54ecee admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033721 Aug 03 12:03:35.309282 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 6/12] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Aug 3 12:03:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:03:37.577485 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-70ece27c-8b6c-426b-8f78-c80ed666f83d admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:37.579238 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-70ece27c-8b6c-426b-8f78-c80ed666f83d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 03 12:03:37.579909 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 7/13] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:03:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:03:38.072338 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-96dae567-8a4f-494f-bb24-7f4a95928d4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:38.093297 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-96dae567-8a4f-494f-bb24-7f4a95928d4a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.507555 Aug 03 12:03:38.094107 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 7/14] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Aug 3 12:03:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:03:38.105944 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-b3212888-f66d-4e78-ae07-ffd0181403f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:38.132451 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-b3212888-f66d-4e78-ae07-ffd0181403f6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030119 Aug 03 12:03:38.133351 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 8/15] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Aug 3 12:03:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:03:40.413504 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-96dae567-8a4f-494f-bb24-7f4a95928d4a admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:40.415620 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-96dae567-8a4f-494f-bb24-7f4a95928d4a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002636 Aug 03 12:03:40.416976 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 8/16] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:03:40 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:03:40.964563 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-19b21205-1c7e-4a60-a027-15b887034b75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:40.985908 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-19b21205-1c7e-4a60-a027-15b887034b75 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.559898 Aug 03 12:03:40.990558 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 9/17] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Aug 3 12:03:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:03:40.999454 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-bc983a97-a6ad-4fb9-9079-7af883821890 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:41.029949 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-bc983a97-a6ad-4fb9-9079-7af883821890 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034620 Aug 03 12:03:41.038515 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 9/18] 10.222.0.17 () {64 vars in 1335 bytes} [Wed Aug 3 12:03:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:03:43.259821 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-19b21205-1c7e-4a60-a027-15b887034b75 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:43.260820 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-19b21205-1c7e-4a60-a027-15b887034b75 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 03 12:03:43.261223 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 10/19] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:03:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:03:43.696718 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-23fccb13-549f-4f51-8306-4ab2f48a3901 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:43.721656 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-23fccb13-549f-4f51-8306-4ab2f48a3901 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.453802 Aug 03 12:03:43.722193 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 10/20] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Aug 3 12:03:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:03:46.401946 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-19b21205-1c7e-4a60-a027-15b887034b75 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:46.402897 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-19b21205-1c7e-4a60-a027-15b887034b75 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 03 12:03:46.403298 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 11/21] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:03:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:03:46.899415 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-d604d99d-d6c7-47ff-9cb5-237dac01948d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:46.930289 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-d604d99d-d6c7-47ff-9cb5-237dac01948d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.519636 Aug 03 12:03:46.931392 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 11/22] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Aug 3 12:03:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:03:46.944205 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-d04f2099-7fd7-4598-ab1e-e258e7b8d8a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:46.969663 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-d04f2099-7fd7-4598-ab1e-e258e7b8d8a0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029306 Aug 03 12:03:46.970241 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 12/23] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Aug 3 12:03:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:03:49.285766 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-d604d99d-d6c7-47ff-9cb5-237dac01948d admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:49.286957 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-d604d99d-d6c7-47ff-9cb5-237dac01948d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Aug 03 12:03:49.287442 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:03:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:03:49.696486 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-f2c4473b-7eca-49b7-a51c-c5c8f57bbaf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:49.716841 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-f2c4473b-7eca-49b7-a51c-c5c8f57bbaf2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423367 Aug 03 12:03:49.717680 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 13/25] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Aug 3 12:03:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 12:03:49.729166 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-567ef410-f8f5-4a14-be15-9e4b352d2c2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:49.754899 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-567ef410-f8f5-4a14-be15-9e4b352d2c2c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029221 Aug 03 12:03:49.755476 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 13/26] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Aug 3 12:03:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:03:52.001463 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-f2c4473b-7eca-49b7-a51c-c5c8f57bbaf2 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:52.002540 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-f2c4473b-7eca-49b7-a51c-c5c8f57bbaf2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 03 12:03:52.003102 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 14/27] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:03:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:03:52.392077 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-d942469c-1746-4f5e-8894-94d0cc61b584 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "name": "m1.medium", "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:52.414623 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-d942469c-1746-4f5e-8894-94d0cc61b584 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.405580 Aug 03 12:03:52.415562 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 14/28] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Aug 3 12:03:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 12:03:52.428067 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-039c3d51-9b8d-4902-a001-f18caaadf59f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:52.467810 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-039c3d51-9b8d-4902-a001-f18caaadf59f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043299 Aug 03 12:03:52.468308 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 15/29] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Aug 3 12:03:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:03:54.809452 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-d942469c-1746-4f5e-8894-94d0cc61b584 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:54.811145 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-d942469c-1746-4f5e-8894-94d0cc61b584 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002138 Aug 03 12:03:54.811721 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 15/30] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:03:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:03:55.292644 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-57fa62d8-c327-477b-b559-dda973c204bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:55.301131 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:03:55.319271 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-57fa62d8-c327-477b-b559-dda973c204bf admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.501015 Aug 03 12:03:55.320093 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 16/31] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Aug 3 12:03:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:03:55.331791 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-60db5512-504e-4823-ab7d-3020af3a5196 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:55.358963 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-60db5512-504e-4823-ab7d-3020af3a5196 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030739 Aug 03 12:03:55.360073 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 16/32] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Aug 3 12:03:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:03:57.639176 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-57fa62d8-c327-477b-b559-dda973c204bf admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:03:57.640107 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-57fa62d8-c327-477b-b559-dda973c204bf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 03 12:03:57.641050 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 17/33] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:03:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:03:58.197323 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-8d7fe6d6-822e-45ab-8b32-cafbec642b99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "id": "5", "disk": 160, "os-flavor-access:is_public": true}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:58.219212 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-8d7fe6d6-822e-45ab-8b32-cafbec642b99 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.571121 Aug 03 12:03:58.227911 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 17/34] 10.222.0.17 () {64 vars in 1282 bytes} [Wed Aug 3 12:03:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:03:58.233687 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-f0bf0af0-0e5e-4085-8c17-5bf11ea4e318 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:03:58.263675 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-f0bf0af0-0e5e-4085-8c17-5bf11ea4e318 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034273 Aug 03 12:03:58.266961 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 18/35] 10.222.0.17 () {64 vars in 1332 bytes} [Wed Aug 3 12:03:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:04:17.398510 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-8d7fe6d6-822e-45ab-8b32-cafbec642b99 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:17.399539 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-8d7fe6d6-822e-45ab-8b32-cafbec642b99 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 03 12:04:17.399938 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 18/36] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:04:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:04:17.411299 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:17.800804 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-dbf6fa99-83ce-4f40-b643-10f161c43e34 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:17.818881 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-dbf6fa99-83ce-4f40-b643-10f161c43e34 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.412006 Aug 03 12:04:17.819428 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 19/37] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Aug 3 12:04:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:04:18.904134 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-8d7fe6d6-822e-45ab-8b32-cafbec642b99 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:18.905121 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-8d7fe6d6-822e-45ab-8b32-cafbec642b99 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 03 12:04:18.905515 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 19/38] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 3 12:04:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:04:19.457300 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-c100a01d-8278-47ea-a6e1-c4730ad5b4e2 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:19.463153 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.wsgi [None req-c100a01d-8278-47ea-a6e1-c4730ad5b4e2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-c100a01d-8278-47ea-a6e1-c4730ad5b4e2 admin admin] Request method failure captured: Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Accept: application/json Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Accept-Encoding: gzip, deflate Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Connection: keep-alive Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Content-Length: 0 Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Host: 10.222.0.17 Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Openstack-Api-Version: compute 2.90 Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Openstack-System-Scope: None Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: User-Agent: python-novaclient Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Auth-Token: gAAAAABi6mRCuIEb0gxb-ibMppewyenv3LAl-De7tPmpASoUZhrZPw1wwtHwx_4C16nA7M9CqLGeVrjYMeLg9_slbBJYRxeKabzcMNBLAV0ltb6S_pSLZBl83K8y5V0wQOsKZbmiJ71KmRIIIF57eedPTRq7rHzQd460ph4nyMcZynsMayRNcuo Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Domain-Id: None Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Domain-Name: None Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Identity-Status: Confirmed Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Is-Admin-Project: True Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Project-Domain-Id: default Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Project-Domain-Name: Default Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Project-Id: fa9288278a154c5e9a414320fa6388fa Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Project-Name: admin Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Role: reader,admin,member Aug 03 12:04:19.466422 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Roles: reader,admin,member Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa9288278a154c5e9a414320fa6388fa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Tenant: admin Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Tenant-Id: fa9288278a154c5e9a414320fa6388fa Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Tenant-Name: admin Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User: admin Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User-Domain-Id: default Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User-Domain-Name: Default Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User-Id: 0ebcadb74d2c4d319371eb661691d94f Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User-Name: admin Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: method: > Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: exception: Flavor 42 could not be found. Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: action_args: {'id': '42'} Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:04:19.469249 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:04:19.470198 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:19.471476 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-c100a01d-8278-47ea-a6e1-c4730ad5b4e2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:04:19.472829 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-c100a01d-8278-47ea-a6e1-c4730ad5b4e2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.423043 Aug 03 12:04:19.472829 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 20/39] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Aug 3 12:04:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:19.478403 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-bfb48f0c-0633-45fd-b1cc-ace1c423cf4d admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:19.482875 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:04:19.504288 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-bfb48f0c-0633-45fd-b1cc-ace1c423cf4d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029483 Aug 03 12:04:19.504874 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 20/40] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 3 12:04:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:04:19.515674 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-84d6737e-97df-4d0a-b0b3-c4b3e731da5b admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:19.540280 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-84d6737e-97df-4d0a-b0b3-c4b3e731da5b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028939 Aug 03 12:04:19.540860 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 21/41] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 3 12:04:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:04:19.551228 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-83fe4df5-5566-4bbb-91fb-d388389ec883 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:19.557634 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.wsgi [None req-83fe4df5-5566-4bbb-91fb-d388389ec883 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-83fe4df5-5566-4bbb-91fb-d388389ec883 admin admin] Request method failure captured: Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Accept: application/json Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Accept-Encoding: gzip, deflate Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Connection: keep-alive Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Content-Length: 0 Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Host: 10.222.0.17 Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Openstack-Api-Version: compute 2.90 Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Openstack-System-Scope: None Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: User-Agent: python-novaclient Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Auth-Token: gAAAAABi6mRCuIEb0gxb-ibMppewyenv3LAl-De7tPmpASoUZhrZPw1wwtHwx_4C16nA7M9CqLGeVrjYMeLg9_slbBJYRxeKabzcMNBLAV0ltb6S_pSLZBl83K8y5V0wQOsKZbmiJ71KmRIIIF57eedPTRq7rHzQd460ph4nyMcZynsMayRNcuo Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Domain-Id: None Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Domain-Name: None Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Identity-Status: Confirmed Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Is-Admin-Project: True Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Project-Domain-Id: default Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Project-Domain-Name: Default Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Project-Id: fa9288278a154c5e9a414320fa6388fa Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Project-Name: admin Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Role: reader,admin,member Aug 03 12:04:19.560937 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Roles: reader,admin,member Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa9288278a154c5e9a414320fa6388fa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Tenant: admin Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Tenant-Id: fa9288278a154c5e9a414320fa6388fa Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Tenant-Name: admin Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User: admin Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User-Domain-Id: default Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User-Domain-Name: Default Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User-Id: 0ebcadb74d2c4d319371eb661691d94f Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User-Name: admin Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: method: > Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: exception: Flavor 42 could not be found. Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: action_args: {'id': '42'} Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:04:19.563015 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:04:19.563870 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:19.564904 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-83fe4df5-5566-4bbb-91fb-d388389ec883 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:04:19.565851 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-83fe4df5-5566-4bbb-91fb-d388389ec883 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016005 Aug 03 12:04:19.565851 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 21/42] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Aug 3 12:04:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:20.547949 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-84d6737e-97df-4d0a-b0b3-c4b3e731da5b admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:20.548964 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-84d6737e-97df-4d0a-b0b3-c4b3e731da5b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 03 12:04:20.549358 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 22/43] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 3 12:04:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:04:21.073599 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-069ba160-6e7c-4905-ba59-c7b0e616f594 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:21.080137 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.wsgi [None req-069ba160-6e7c-4905-ba59-c7b0e616f594 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-069ba160-6e7c-4905-ba59-c7b0e616f594 admin admin] Request method failure captured: Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Accept: application/json Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Accept-Encoding: gzip, deflate Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Connection: keep-alive Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Content-Length: 0 Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Host: 10.222.0.17 Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Openstack-Api-Version: compute 2.90 Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Openstack-System-Scope: None Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: User-Agent: python-novaclient Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Auth-Token: gAAAAABi6mREoGYEMWNs9fzIQb6mrWLkIIZTuA-Cgr83vByj0I2giy_3IoAz8dGnRj2-O9UEH9TzxYp2_ToGwk5aEc9PdK59ltY2mpLYNxGcix-uAtlLuXw2GBJz937Zbl7ti5kc_y7rNCcVcRF2z6F7GY7AFuUpIdu3X8ZFYSEiDMGvQ64W9LQ Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Domain-Id: None Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Domain-Name: None Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Identity-Status: Confirmed Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Is-Admin-Project: True Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Project-Domain-Id: default Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Project-Domain-Name: Default Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Project-Id: fa9288278a154c5e9a414320fa6388fa Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Project-Name: admin Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Role: reader,admin,member Aug 03 12:04:21.081676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Roles: reader,admin,member Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa9288278a154c5e9a414320fa6388fa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Tenant: admin Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Tenant-Id: fa9288278a154c5e9a414320fa6388fa Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Tenant-Name: admin Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User: admin Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User-Domain-Id: default Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User-Domain-Name: Default Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User-Id: 0ebcadb74d2c4d319371eb661691d94f Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User-Name: admin Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: method: > Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: exception: Flavor 84 could not be found. Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: action_args: {'id': '84'} Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:04:21.083209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:04:21.084091 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:21.085118 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-069ba160-6e7c-4905-ba59-c7b0e616f594 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:04:21.086247 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-069ba160-6e7c-4905-ba59-c7b0e616f594 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394428 Aug 03 12:04:21.086247 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 22/44] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Aug 3 12:04:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 03 12:04:21.093088 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-39ab61c4-fbea-4102-9637-8759bb12e52b admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:21.107761 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-39ab61c4-fbea-4102-9637-8759bb12e52b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018281 Aug 03 12:04:21.108298 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 23/45] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 3 12:04:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:04:21.117927 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-4a6e21b2-66d8-47b1-b465-a01876999c72 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:21.133883 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-4a6e21b2-66d8-47b1-b465-a01876999c72 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019365 Aug 03 12:04:21.134501 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 23/46] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 3 12:04:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:04:21.144457 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-a059b916-382b-488f-80b2-e09e7d64773f admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:21.150646 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.wsgi [None req-a059b916-382b-488f-80b2-e09e7d64773f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-a059b916-382b-488f-80b2-e09e7d64773f admin admin] Request method failure captured: Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Accept: application/json Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Accept-Encoding: gzip, deflate Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Connection: keep-alive Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Content-Length: 0 Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Host: 10.222.0.17 Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Openstack-Api-Version: compute 2.90 Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Openstack-System-Scope: None Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: User-Agent: python-novaclient Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Auth-Token: gAAAAABi6mREoGYEMWNs9fzIQb6mrWLkIIZTuA-Cgr83vByj0I2giy_3IoAz8dGnRj2-O9UEH9TzxYp2_ToGwk5aEc9PdK59ltY2mpLYNxGcix-uAtlLuXw2GBJz937Zbl7ti5kc_y7rNCcVcRF2z6F7GY7AFuUpIdu3X8ZFYSEiDMGvQ64W9LQ Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Domain-Id: None Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Domain-Name: None Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Identity-Status: Confirmed Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Is-Admin-Project: True Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Project-Domain-Id: default Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Project-Domain-Name: Default Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Project-Id: fa9288278a154c5e9a414320fa6388fa Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Project-Name: admin Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Role: reader,admin,member Aug 03 12:04:21.152206 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Roles: reader,admin,member Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa9288278a154c5e9a414320fa6388fa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Tenant: admin Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Tenant-Id: fa9288278a154c5e9a414320fa6388fa Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Tenant-Name: admin Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User: admin Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User-Domain-Id: default Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User-Domain-Name: Default Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User-Id: 0ebcadb74d2c4d319371eb661691d94f Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User-Name: admin Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: method: > Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: exception: Flavor 84 could not be found. Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: action_args: {'id': '84'} Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:04:21.153468 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:04:21.154319 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:21.155671 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-a059b916-382b-488f-80b2-e09e7d64773f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:04:21.156912 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-a059b916-382b-488f-80b2-e09e7d64773f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012674 Aug 03 12:04:21.156912 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 24/47] 10.222.0.17 () {60 vars in 1190 bytes} [Wed Aug 3 12:04:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:22.132720 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-4a6e21b2-66d8-47b1-b465-a01876999c72 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:22.133725 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-4a6e21b2-66d8-47b1-b465-a01876999c72 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 03 12:04:22.134126 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 24/48] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 3 12:04:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:04:22.661192 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-a0a71b50-6e6b-46f4-9b47-980d47c3e69a admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:22.666949 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.wsgi [None req-a0a71b50-6e6b-46f4-9b47-980d47c3e69a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-a0a71b50-6e6b-46f4-9b47-980d47c3e69a admin admin] Request method failure captured: Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Accept: application/json Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Accept-Encoding: gzip, deflate Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Connection: keep-alive Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Content-Length: 0 Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Host: 10.222.0.17 Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Openstack-Api-Version: compute 2.90 Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Openstack-System-Scope: None Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: User-Agent: python-novaclient Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Auth-Token: gAAAAABi6mRG8hZ3Q8iecHuBgjxBqrY1_3aYU8z8hC6ANxOQsRMTE49SbpH_x5bzH4S6SFPzs045z-QZGOTUv2uFcsbCLPttFNkxC58cPHY-tpmavXlOL0gZQxRyRONTCYKOTJQUQE92OMrLivAkRS8RfF4loTyqUWTR2eU2wtzXjl6k1yLJMSc Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Domain-Id: None Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Domain-Name: None Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Identity-Status: Confirmed Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Is-Admin-Project: True Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Project-Domain-Id: default Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Project-Domain-Name: Default Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Project-Id: fa9288278a154c5e9a414320fa6388fa Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Project-Name: admin Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Role: reader,admin,member Aug 03 12:04:22.668440 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Roles: reader,admin,member Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa9288278a154c5e9a414320fa6388fa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Tenant: admin Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Tenant-Id: fa9288278a154c5e9a414320fa6388fa Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-Tenant-Name: admin Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User: admin Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User-Domain-Id: default Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User-Domain-Name: Default Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User-Id: 0ebcadb74d2c4d319371eb661691d94f Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: X-User-Name: admin Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: method: > Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: exception: Flavor 451 could not be found. Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: action_args: {'id': '451'} Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:04:22.670208 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:04:22.671347 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: ERROR nova.api.openstack.wsgi Aug 03 12:04:22.672757 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-a0a71b50-6e6b-46f4-9b47-980d47c3e69a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103381) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:04:22.674021 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-a0a71b50-6e6b-46f4-9b47-980d47c3e69a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.396898 Aug 03 12:04:22.674021 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 25/49] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 3 12:04:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:22.680142 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-7b0b1fc9-f1f5-4bc3-92df-07c85c505028 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:22.695335 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-7b0b1fc9-f1f5-4bc3-92df-07c85c505028 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018733 Aug 03 12:04:22.695867 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 25/50] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 3 12:04:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:04:22.706139 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:22.720956 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018979 Aug 03 12:04:22.721482 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 26/51] 10.222.0.17 () {60 vars in 1210 bytes} [Wed Aug 3 12:04:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:04:22.730676 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-6993dc88-3c09-402e-992b-51b6a8b2188a admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:22.737052 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.wsgi [None req-6993dc88-3c09-402e-992b-51b6a8b2188a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-6993dc88-3c09-402e-992b-51b6a8b2188a admin admin] Request method failure captured: Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Accept: application/json Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Accept-Encoding: gzip, deflate Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Connection: keep-alive Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Content-Length: 0 Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Host: 10.222.0.17 Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Openstack-Api-Version: compute 2.90 Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Openstack-System-Scope: None Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: User-Agent: python-novaclient Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Auth-Token: gAAAAABi6mRG8hZ3Q8iecHuBgjxBqrY1_3aYU8z8hC6ANxOQsRMTE49SbpH_x5bzH4S6SFPzs045z-QZGOTUv2uFcsbCLPttFNkxC58cPHY-tpmavXlOL0gZQxRyRONTCYKOTJQUQE92OMrLivAkRS8RfF4loTyqUWTR2eU2wtzXjl6k1yLJMSc Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Domain-Id: None Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Domain-Name: None Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Identity-Status: Confirmed Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Is-Admin-Project: True Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Project-Domain-Id: default Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Project-Domain-Name: Default Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Project-Id: fa9288278a154c5e9a414320fa6388fa Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Project-Name: admin Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Role: reader,admin,member Aug 03 12:04:22.738521 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Roles: reader,admin,member Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa9288278a154c5e9a414320fa6388fa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa9288278a154c5e9a414320fa6388fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Tenant: admin Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Tenant-Id: fa9288278a154c5e9a414320fa6388fa Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-Tenant-Name: admin Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User: admin Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User-Domain-Id: default Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User-Domain-Name: Default Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User-Id: 0ebcadb74d2c4d319371eb661691d94f Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: X-User-Name: admin Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: method: > Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: exception: Flavor 451 could not be found. Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: action_args: {'id': '451'} Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:04:22.740057 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:04:22.741006 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: ERROR nova.api.openstack.wsgi Aug 03 12:04:22.742344 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-6993dc88-3c09-402e-992b-51b6a8b2188a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:04:22.743668 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-6993dc88-3c09-402e-992b-51b6a8b2188a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012712 Aug 03 12:04:22.743668 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 26/52] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 3 12:04:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 12:04:23.723683 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:23.724758 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 03 12:04:23.725183 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 27/53] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 3 12:04:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:04:24.395497 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-0bb0bdb9-4b46-4063-9d0c-7b8356bb5db5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:04:24.414561 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-0bb0bdb9-4b46-4063-9d0c-7b8356bb5db5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.542071 Aug 03 12:04:24.415109 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 27/54] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Aug 3 12:04:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:04:25.405533 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:25.407070 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002027 Aug 03 12:04:25.407465 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 28/55] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 3 12:04:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:04:25.935705 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-42010384-e9de-4fb3-b8b7-cebc77b7bf02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:04:25.954624 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-42010384-e9de-4fb3-b8b7-cebc77b7bf02 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.410701 Aug 03 12:04:25.955171 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 28/56] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Aug 3 12:04:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:04:26.921863 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:26.922908 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 03 12:04:26.923315 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 29/57] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 3 12:04:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:04:27.458959 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-5c096252-1620-4bf2-8362-fc21026db3e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:04:27.478209 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-5c096252-1620-4bf2-8362-fc21026db3e8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.417074 Aug 03 12:04:27.478792 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 29/58] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Aug 3 12:04:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:04:28.459270 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:28.460258 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 03 12:04:28.460649 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 30/59] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 3 12:04:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:04:28.982778 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-03fd476c-8866-4df2-8048-f75efb9bb0cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:04:29.002574 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-03fd476c-8866-4df2-8048-f75efb9bb0cc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.400733 Aug 03 12:04:29.003116 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 30/60] 10.222.0.17 () {64 vars in 1235 bytes} [Wed Aug 3 12:04:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:04:29.981533 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:29.982588 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 03 12:04:29.982988 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 31/61] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 3 12:04:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:04:30.527269 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-b433d1b3-168f-4fdc-89e0-06d80d470ea5 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:04:30.547975 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-b433d1b3-168f-4fdc-89e0-06d80d470ea5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.429118 Aug 03 12:04:30.548514 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 31/62] 10.222.0.17 () {60 vars in 1202 bytes} [Wed Aug 3 12:04:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:05:22.673712 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:05:22.674760 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-0bbda1c7-9ea7-4237-947e-b3ca8049ff77 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 03 12:05:22.675152 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 32/63] 10.222.0.17 () {54 vars in 930 bytes} [Wed Aug 3 12:05:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:05:22.685701 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:23.069561 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-b7979ac9-1aa3-4ba8-ac92-6dfbccc5b5be admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:05:23.090828 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-b7979ac9-1aa3-4ba8-ac92-6dfbccc5b5be admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409269 Aug 03 12:05:23.091293 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 32/64] 10.222.0.17 () {60 vars in 1291 bytes} [Wed Aug 3 12:05:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:05:23.112781 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG dbcounter [-] [103381] Writing DB stats nova_api:SELECT=14 {{(pid=103381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:05:23.117067 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-9e468a1f-4e8e-4ba8-86d3-c7722656c59b admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:05:23.125289 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-9e468a1f-4e8e-4ba8-86d3-c7722656c59b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013854 Aug 03 12:05:23.125852 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 33/65] 10.222.0.17 () {60 vars in 1282 bytes} [Wed Aug 3 12:05:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:05:23.138336 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-d4443726-319a-4772-8497-72314d90875b admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:05:23.147033 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-d4443726-319a-4772-8497-72314d90875b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012424 Aug 03 12:05:23.147600 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 33/66] 10.222.0.17 () {60 vars in 1285 bytes} [Wed Aug 3 12:05:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:05:23.160418 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-fe8da0da-7b89-4a13-8358-05706e2dea70 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:05:23.168748 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-fe8da0da-7b89-4a13-8358-05706e2dea70 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012004 Aug 03 12:05:23.169316 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 34/67] 10.222.0.17 () {60 vars in 1285 bytes} [Wed Aug 3 12:05:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:05:23.181437 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-21f59e7d-871e-41b8-b504-c3b4785895bc admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:05:23.189872 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-21f59e7d-871e-41b8-b504-c3b4785895bc admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012198 Aug 03 12:05:23.190472 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 34/68] 10.222.0.17 () {60 vars in 1282 bytes} [Wed Aug 3 12:05:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:08:47.239988 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-fe8da0da-7b89-4a13-8358-05706e2dea70 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:08:47.241000 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-fe8da0da-7b89-4a13-8358-05706e2dea70 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 03 12:08:47.241395 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 35/69] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 3 12:08:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:08:47.382705 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writing DB stats nova_api:SELECT=6 {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:08:47.554707 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-10e4450f-4814-459a-83b6-034582fd1ca3 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:08:47.557028 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:08:47.557028 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: warnings.warn(msg) Aug 03 12:08:47.558969 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-10e4450f-4814-459a-83b6-034582fd1ca3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:08:47.559726 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-10e4450f-4814-459a-83b6-034582fd1ca3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:08:47.561897 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-10e4450f-4814-459a-83b6-034582fd1ca3 admin admin] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:08:47.562900 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-10e4450f-4814-459a-83b6-034582fd1ca3 admin admin] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:08:47.603327 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-10e4450f-4814-459a-83b6-034582fd1ca3 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.222299 Aug 03 12:08:47.603914 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 35/70] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 3 12:08:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:08:48.462051 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-fe8da0da-7b89-4a13-8358-05706e2dea70 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:08:48.463758 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-fe8da0da-7b89-4a13-8358-05706e2dea70 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002391 Aug 03 12:08:48.464437 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 36/71] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 3 12:08:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:08:48.662933 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-72f5c6fe-3830-4934-ab9c-565d23848195 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:08:48.665744 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:08:48.665744 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: warnings.warn(msg) Aug 03 12:08:48.667074 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-72f5c6fe-3830-4934-ab9c-565d23848195 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:08:48.667556 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-72f5c6fe-3830-4934-ab9c-565d23848195 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:08:48.668295 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-72f5c6fe-3830-4934-ab9c-565d23848195 admin admin] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:08:48.668723 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-72f5c6fe-3830-4934-ab9c-565d23848195 admin admin] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:08:48.689667 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-72f5c6fe-3830-4934-ab9c-565d23848195 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082078 Aug 03 12:08:48.690251 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 36/72] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 3 12:08:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 12:08:59.943087 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-fe8da0da-7b89-4a13-8358-05706e2dea70 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:08:59.944078 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-fe8da0da-7b89-4a13-8358-05706e2dea70 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 03 12:08:59.944496 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 37/73] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 3 12:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:09:00.087019 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writing DB stats nova_cell0:SELECT=4 {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:09:00.087656 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writing DB stats nova_cell1:SELECT=4 {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:09:00.088377 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG dbcounter [-] [103382] Writing DB stats nova_api:SELECT=8 {{(pid=103382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:09:00.137258 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-2f50ec46-fde3-43a7-a151-91dfa315845c admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:09:00.140296 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:09:00.140296 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: warnings.warn(msg) Aug 03 12:09:00.141719 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-2f50ec46-fde3-43a7-a151-91dfa315845c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:09:00.142149 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-2f50ec46-fde3-43a7-a151-91dfa315845c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:09:00.142946 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-2f50ec46-fde3-43a7-a151-91dfa315845c admin admin] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:09:00.143362 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-2f50ec46-fde3-43a7-a151-91dfa315845c admin admin] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:09:00.168196 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-2f50ec46-fde3-43a7-a151-91dfa315845c admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085712 Aug 03 12:09:00.168751 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 37/74] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 3 12:09:00 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:09:01.005170 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: DEBUG nova.api.openstack.wsgi [None req-fe8da0da-7b89-4a13-8358-05706e2dea70 admin admin] Calling method '>' {{(pid=103381) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:09:01.006163 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: INFO nova.api.openstack.requestlog [None req-fe8da0da-7b89-4a13-8358-05706e2dea70 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 03 12:09:01.006596 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: [pid: 103381|app: 0|req: 38/75] 10.222.0.17 () {56 vars in 1074 bytes} [Wed Aug 3 12:09:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:09:01.202217 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG nova.api.openstack.wsgi [None req-190ac6e7-4063-493a-90cc-8c128ad13a84 admin admin] Calling method '>' {{(pid=103382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:09:01.204658 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:09:01.204658 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: warnings.warn(msg) Aug 03 12:09:01.205833 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-190ac6e7-4063-493a-90cc-8c128ad13a84 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:09:01.206301 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-190ac6e7-4063-493a-90cc-8c128ad13a84 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:09:01.207098 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-190ac6e7-4063-493a-90cc-8c128ad13a84 admin admin] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:09:01.207511 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: DEBUG oslo_concurrency.lockutils [None req-190ac6e7-4063-493a-90cc-8c128ad13a84 admin admin] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:09:01.232442 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: INFO nova.api.openstack.requestlog [None req-190ac6e7-4063-493a-90cc-8c128ad13a84 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084941 Aug 03 12:09:01.233328 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: [pid: 103382|app: 0|req: 38/76] 10.222.0.17 () {60 vars in 1193 bytes} [Wed Aug 3 12:09:01 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:09:59.609961 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: Wed Aug 3 12:09:59 2022 - graceful shutdown triggered... Aug 03 12:09:59.610180 dv-cinder-836027-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 03 12:09:59.611890 dv-cinder-836027-3-iscsi devstack@n-api.service[103381]: Gracefully killing worker 1 (pid: 103381)... Aug 03 12:09:59.612397 dv-cinder-836027-3-iscsi devstack@n-api.service[103382]: Gracefully killing worker 2 (pid: 103382)... Aug 03 12:10:00.613000 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: worker 1 buried after 1 seconds Aug 03 12:10:00.613000 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: worker 2 buried after 1 seconds Aug 03 12:10:00.613000 dv-cinder-836027-3-iscsi devstack@n-api.service[103380]: goodbye to uWSGI. Aug 03 12:10:00.614810 dv-cinder-836027-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 03 12:10:00.615407 dv-cinder-836027-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 03 12:10:00.618376 dv-cinder-836027-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 12:10:00.634731 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 12:10:00.638925 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 12:10:00 2022] *** Aug 03 12:10:00.638925 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 12:10:00.638925 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 12:10:00.638925 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: nodename: dv-cinder-836027-3-iscsi Aug 03 12:10:00.638925 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: machine: x86_64 Aug 03 12:10:00.638925 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: clock source: unix Aug 03 12:10:00.638925 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: pcre jit disabled Aug 03 12:10:00.638925 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: detected number of CPU cores: 4 Aug 03 12:10:00.638925 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: current working directory: / Aug 03 12:10:00.638925 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: detected binary path: /usr/bin/uwsgi-core Aug 03 12:10:00.638925 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: your processes number limit is 47680 Aug 03 12:10:00.638925 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: your memory page size is 4096 bytes Aug 03 12:10:00.640442 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: detected max file descriptor number: 2048 Aug 03 12:10:00.640442 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: lock engine: pthread robust mutexes Aug 03 12:10:00.640442 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: thunder lock: enabled Aug 03 12:10:00.640442 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 12:10:00.640442 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 12:10:00.685674 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: Python main interpreter initialized at 0x55905a7dd9c0 Aug 03 12:10:00.685674 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: python threads support enabled Aug 03 12:10:00.685674 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: your server socket listen backlog is limited to 100 connections Aug 03 12:10:00.685674 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: your mercy for graceful operations on workers is 90 seconds Aug 03 12:10:00.686235 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 12:10:00.686235 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: *** Operational MODE: preforking *** Aug 03 12:10:00.686501 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: *** uWSGI is running in multiple interpreter mode *** Aug 03 12:10:00.686501 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: spawned uWSGI master process (pid: 117891) Aug 03 12:10:00.686639 dv-cinder-836027-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 12:10:00.689984 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: spawned uWSGI worker 1 (pid: 117910, cores: 1) Aug 03 12:10:00.689984 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: spawned uWSGI worker 2 (pid: 117911, cores: 1) Aug 03 12:10:00.689984 dv-cinder-836027-3-iscsi devstack@n-api.service[117891]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 12:10:01.709277 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 12:10:01.727179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 12:10:03.113813 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:10:03.113813 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: from cryptography.utils import int_from_bytes Aug 03 12:10:03.114961 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:10:03.114961 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: from cryptography.utils import int_from_bytes Aug 03 12:10:03.145357 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:10:03.145357 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: from cryptography.utils import int_from_bytes Aug 03 12:10:03.146259 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:10:03.146259 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: from cryptography.utils import int_from_bytes Aug 03 12:10:05.655011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:10:05.655821 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:10:05.655821 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:10:05.656346 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:10:05.656509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:10:05.656848 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.657189 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.657527 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.657872 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.658215 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.658554 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.658891 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.659218 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.659557 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.659830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.660146 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.660514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-3-iscsi {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.660810 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.661321 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.661650 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.661985 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.662301 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.662677 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.662993 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.663519 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.665211 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.665522 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.665863 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.666230 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.666596 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.666928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.667279 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.667608 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.668030 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.668445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.668770 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-3-iscsi {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.669721 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.670129 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.670129 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.670847 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.670847 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.671661 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.671661 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.672367 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.672367 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.672933 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.672933 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.673504 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.673504 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.674034 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.674034 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.674641 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.675061 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.675412 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.675665 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.675924 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.676402 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.678004 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.678004 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.678004 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.678004 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.678004 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.679313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.679313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.679313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.679313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.680260 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.680260 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.680260 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.680971 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.680971 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.681442 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.681442 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.681915 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.682154 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.682393 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.682713 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.683260 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.683536 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.683809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.684066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.684294 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.685266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.685555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.685821 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.686070 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.686396 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.686936 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.688702 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.688702 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.688702 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.688702 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.688702 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.688702 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.690100 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.690100 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.690100 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.690100 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.690100 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.691393 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.691393 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.691393 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.691393 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.692319 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.692319 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.692319 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.693002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.693002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.693002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.693723 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.693723 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.694167 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.694167 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.694685 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.695482 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.695482 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.695817 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.696114 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.696366 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.696635 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.702485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.702485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.702485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.702485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.702485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.702485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.702485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.702485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.703920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.703920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.703920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.703920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.703920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.703920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.703920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.703920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.705046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.705046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.705046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.705046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.705046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.705046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:05.705046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.705046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.706422 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.706422 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.706422 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.706422 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.706422 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.706422 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.706422 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.707480 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.707480 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.707480 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.707480 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.708217 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.708217 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.708613 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.708818 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.709030 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.714487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.714487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.714487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.714487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.714487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.714487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.714487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.714487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.716226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.716226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.716226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.716226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.716226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.716226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.716226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.716226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.717809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.717809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.717809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.717809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.717809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.717809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.717809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.717809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.719652 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.719652 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.719652 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.719652 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.719652 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.719652 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.719652 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.719652 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.721952 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.721952 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.721952 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.721952 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.721952 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.721952 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.721952 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.721952 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.724101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.724101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.724101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.724101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.724101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.724101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.724101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.724101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.725939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.725939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.725939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.725939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.725939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.725939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.727329 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.727329 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.727329 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.727329 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.728220 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.728220 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.728220 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.728924 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.728924 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.729363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.729363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.730068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.730068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.730590 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.730590 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.731227 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.731227 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.732332 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.732332 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.732802 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.733042 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.733280 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.733545 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.733778 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.734023 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.734347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.734677 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.734996 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.735307 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.735609 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.735967 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.736281 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.736631 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.737170 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.737426 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.737671 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.737899 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.738291 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.738603 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.738923 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.739212 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.739618 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.739866 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.740162 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.740451 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.740832 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.741082 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.741379 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.741703 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.742023 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.742584 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.742949 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.743303 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.743629 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.743962 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.744279 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.744599 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.744915 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.745230 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.745545 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.745859 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.746186 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.746532 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.746856 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.747724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.748070 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.748386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.748713 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.749022 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.749339 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.749718 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.750015 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.750332 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.750678 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.751002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.751320 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.751634 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.751958 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.752270 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.752579 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.752944 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.753255 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.753567 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.753880 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.754364 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.754652 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.754918 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.755141 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.755431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.755750 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.756210 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.756459 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.756721 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.757202 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.757448 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.757675 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.757974 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.758350 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.758695 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.759012 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.759323 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.759682 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.759998 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.760312 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.760638 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.760968 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.761287 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.761614 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.761935 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.762252 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.762613 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.762980 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.763297 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.763615 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.763932 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.764251 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.764564 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.764896 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.765213 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.765528 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.765844 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.766324 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.766931 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.767154 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.767675 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.768019 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.768342 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.768668 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.768997 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.769321 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.769669 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.770005 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.770355 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.770723 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.771044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.771359 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.771671 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.772050 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.772282 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.772596 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.772909 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.773226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.773538 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.773850 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.774159 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.774536 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.774827 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.775138 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.775459 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.775770 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.776110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.776434 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.776733 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.777046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.777357 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.777713 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.778025 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.778408 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.778796 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.779148 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.779592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.779841 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.780133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.780446 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.780887 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.781144 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.781377 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.781666 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.781981 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.782299 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.782645 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.782960 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.783276 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.783585 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.784764 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.784764 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.784764 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.785420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.785420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.785420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.786068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.786068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.786638 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.786638 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.787076 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.787318 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.787580 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.787932 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.788244 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.788560 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.788875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.789184 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.789782 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.790007 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.790243 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.790530 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.790781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.791094 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.791555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.791808 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.792035 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.793781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.793781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.793781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.793781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.793781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.793781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.795733 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.795733 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.795733 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.795733 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.797583 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.797583 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.797583 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.797583 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.797583 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.797583 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.798994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.798994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.798994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.798994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.798994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.800449 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.800449 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.800449 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.800449 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.801585 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.801585 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.801585 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.801585 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.802868 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.802868 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.802868 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.803607 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.803607 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.804069 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.804293 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.804770 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.805036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.805249 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.805556 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.805877 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.806196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.806581 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.807240 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.807240 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.807783 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.808003 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.808218 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.808540 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.808861 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.809182 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.809563 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.810688 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.810878 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.811176 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.811457 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.811791 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.812098 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.812417 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.812731 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.813185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.813509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.813829 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.814141 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.814491 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.814804 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.815128 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.815455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.815770 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.816210 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.816529 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.816847 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.817206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.817524 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.817837 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.818156 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.818522 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.818838 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.819148 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.819458 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.819788 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.820102 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.820431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.820883 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.821201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.821512 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.821943 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.822259 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.822613 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.822944 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.823275 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.823609 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.823921 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.824244 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.824611 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.824948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.825312 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.825637 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.825960 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.826273 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.826635 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.826970 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.827293 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.827624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.828067 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.828400 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.828719 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.829052 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.829387 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.829700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.830011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.830330 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.830674 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.831042 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.831349 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.831663 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.832017 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.832340 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.832612 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.832927 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.833239 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.833573 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.833884 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.834214 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.834564 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.834900 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.835228 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.835539 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.835869 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.836184 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.836494 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.836803 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.837112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.839254 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.839254 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.839254 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.839254 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.839254 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.839254 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.840087 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.840087 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.840397 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.840563 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.840818 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.841257 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.841471 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.841758 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.842076 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.842380 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.843776 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.844110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.844450 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.844776 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.845098 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.845447 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.845768 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.846106 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.846431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.846778 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.847096 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.847414 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.850027 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.850027 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.850027 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.850027 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.850027 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.850027 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.850027 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.850027 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.851208 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.851208 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.851208 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.851208 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.851917 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.851917 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.852183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.852468 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.853057 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.853403 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.853713 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.854034 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.854354 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.854711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.855031 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.855349 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.855668 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.855985 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.857133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.857460 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.857799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.858136 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.858498 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.858832 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.859155 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.859479 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.859797 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.860168 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.860491 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.860805 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.861126 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.861495 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.861769 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.862083 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.862400 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.862752 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.863074 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.863390 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.863710 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.864026 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.864347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.864684 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.865028 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.865355 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.865670 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.865988 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.866310 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.866941 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.867268 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.867615 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.867947 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.868281 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.868603 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.868930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.869269 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.869581 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.869890 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.870209 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.870557 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.870870 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.871201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.871525 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.871845 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.872226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.873051 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.873646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.874008 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.874333 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.874699 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.875035 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.875360 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.875676 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.876011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.876324 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.876637 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.876960 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.877319 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.877633 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.877944 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.878264 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.878610 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.878918 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.879240 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.879545 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.879885 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.880196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.880508 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.880818 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.881135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.881445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.881763 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.882078 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.882382 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.882736 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.883057 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.883373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.883700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.883992 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.884404 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.884735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.885123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.885470 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.885785 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.886155 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.887878 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.887878 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.887878 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.887878 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.888372 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.888372 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.888646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.889171 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.889519 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.889851 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.890203 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.890567 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.890886 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.891202 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.891516 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.892120 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.892438 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.892755 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.893075 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.893396 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.893717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.894032 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.894350 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.894700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.895018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.895334 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.895651 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.895965 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.896280 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.896594 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.896921 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.897282 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.897610 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.897932 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.898258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.898611 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.898929 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.899269 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.899568 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.899933 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.900209 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.900544 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.900865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.901179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.901621 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.901941 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.902349 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.902718 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.903044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.903910 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.904241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.904559 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.904889 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.905211 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.905546 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.905896 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.906234 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.906596 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.906909 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.907223 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.907629 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.907984 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.908313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.908639 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.908951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.909258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.909576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.909894 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.910200 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.910543 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.910916 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.911165 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.911476 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.911785 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.912092 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.912480 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.912794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.913108 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.913428 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.913762 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.914088 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.914395 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.914737 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.915059 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.915435 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.915753 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.916079 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.916404 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.916724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.917052 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.917364 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.917693 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.918023 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.918351 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.918799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.919713 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.920034 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.920357 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.920676 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.920989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.921307 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.921626 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.921965 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.922296 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.922641 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.922977 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.923301 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.923639 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.923961 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.924279 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.924615 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.924931 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.925256 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.925567 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.925882 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.926200 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.926552 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.926869 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.927184 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.927503 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.927820 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.928155 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.928488 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.928801 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.929134 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.929469 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.929828 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.930142 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.930523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.930863 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.931184 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.931502 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.931813 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:05.932062 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:10:05.995587 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO dbcounter [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] Registered counter for database nova_api Aug 03 12:10:06.021218 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_db.sqlalchemy.engines [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:10:06.030684 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writer thread running {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:10:06.092795 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.context [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b78e12ae-4961-43a7-b06c-67318250b51a(cell1) {{(pid=117910) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 12:10:06.097252 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:10:06.098994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:10:06.099865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:10:06.102106 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:10:06.104378 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO dbcounter [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] Registered counter for database nova_cell0 Aug 03 12:10:06.109591 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO dbcounter [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] Registered counter for database nova_cell1 Aug 03 12:10:06.114740 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:10:06.115547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:10:06.116167 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:10:06.116888 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:10:06.117370 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:10:06.118077 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.118723 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.119321 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.119809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_db.sqlalchemy.engines [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:10:06.119980 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.120510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.121061 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.121474 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_db.sqlalchemy.engines [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:10:06.121660 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.122138 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.122790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.123271 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.123832 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.124458 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-3-iscsi {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.125069 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.125979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.126594 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.127187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.127769 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.128497 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.128985 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.129934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.130465 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.131030 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.131368 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writer thread running {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:10:06.131615 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.132269 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.132850 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.132959 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writer thread running {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:10:06.133420 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.134084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.134700 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.135334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.135921 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.136612 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-3-iscsi {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.137186 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.137770 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.138374 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.139210 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.139822 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.140398 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.141018 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.141628 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.142489 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.143127 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.143716 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.144312 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.144904 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.145485 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.146075 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.146702 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.147304 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.147869 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.148428 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.148861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.149440 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.150052 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.150695 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.151298 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.151780 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.152252 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.152867 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.154033 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.154643 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.155235 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.155808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.156331 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.156837 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.157429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.158018 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.158655 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.159380 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.159983 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.160584 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.161178 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.161769 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.162598 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.163089 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.163692 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.164362 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.164975 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.165486 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.166057 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.166625 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.167201 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.167787 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.168589 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.169779 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.170394 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.171081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.171518 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.172088 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.172643 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.173258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.173829 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.174414 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.175035 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.175611 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.176198 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.176765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.177358 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.177924 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.178538 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.179127 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.179700 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.180272 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.180761 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.181289 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.181853 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.182276 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.182812 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.183359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.183914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.184483 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.185095 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.185692 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.186288 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.186918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.187551 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.188175 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.188787 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.189360 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.189960 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.190563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.191137 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.191752 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.192345 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.192941 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.193529 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.194062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.194680 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.195263 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.195836 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.196448 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.197034 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.197671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.198204 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.198822 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.199397 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.199962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.200606 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:10:06.201228 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.201837 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.202656 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.203255 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.203862 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.204254 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.204602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.204994 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.205403 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.205922 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.206262 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.206804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.207365 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.207960 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.208594 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.209182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.209778 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.210367 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.210979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.211582 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.212197 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.212801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.213404 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.213990 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.214665 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.215317 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.216436 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.217036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.217655 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.218244 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.218859 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.219420 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.220033 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.220558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.221148 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.221747 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.222287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.222886 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.223435 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.224023 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.224623 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.225268 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.225846 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.226415 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.227047 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.227629 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.228199 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.228789 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.229389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.229957 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.230573 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.231131 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.232273 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.232829 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.233433 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.234045 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.234655 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.235286 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.235866 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.236453 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.237042 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.237626 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.238172 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.238747 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.239621 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.240206 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.240828 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.241400 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.241975 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.242603 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.243182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.243741 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.244465 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.245058 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.246779 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.247197 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.247702 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.248306 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.248923 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.249535 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.250380 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.250923 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.251492 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.252099 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.252687 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.253392 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.253904 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.254501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.255055 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.255612 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.256184 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.256769 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.257351 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.257920 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.258548 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.259121 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.259698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.260471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.261054 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.261685 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.262232 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.262869 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.263503 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.264072 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.264723 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.265366 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.265961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.266592 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.267459 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.267969 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.268501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.268943 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.269452 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.269990 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.270594 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.271316 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.271953 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.272553 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.273164 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.273732 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.274328 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.274933 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.275665 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.276306 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.276943 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.277604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.278229 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.279718 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.279971 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.280568 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.281140 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.281723 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.282336 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.283148 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.283761 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.284357 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.284939 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.285544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.286136 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.287107 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.288036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.288649 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.289470 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.291074 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.291074 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.291074 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.291664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.292271 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.292872 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.293664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.295147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.296008 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.297944 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.298651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.299575 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.300261 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.301176 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.301489 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.302124 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.302819 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.303410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.304113 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.304771 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.305430 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.306017 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.306691 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.307569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.307804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.308635 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.309142 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.309790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.310476 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.311161 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.312286 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.312907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.313511 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.314405 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.315416 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.316831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.316831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.317361 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.318006 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.318650 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.319240 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.319837 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.320429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.321018 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.321593 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.322170 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.322843 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.323711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.324516 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.325103 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.326241 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.326880 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.327483 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.328629 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.329270 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.329905 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.330639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.331256 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.331852 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.332571 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.333203 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.333979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.334878 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.335428 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.336127 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.336709 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.337436 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.338109 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.338722 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.339370 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.339924 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.340556 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.341790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.342375 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.342993 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.343581 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.344142 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.344711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.345281 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.345910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.346523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.347108 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.347690 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.348262 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.348926 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.349510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.350126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.350776 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.351433 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.351997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.352578 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.353212 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.353781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.354356 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.354953 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.355553 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.356159 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.356781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.357380 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.358069 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.358770 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.359325 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.359919 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.360483 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.361068 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.361590 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO dbcounter [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] Registered counter for database nova_cell0 Aug 03 12:10:06.361872 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.362367 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.363062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.363777 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.364630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.365116 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.365688 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.366286 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.366900 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.367521 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.368089 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.368912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.369590 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.370197 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.370825 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.371399 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.372034 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.372619 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_db.sqlalchemy.engines [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:10:06.372804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.373248 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.373823 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.374411 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.375009 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.375630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.376251 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.376863 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.377461 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.378050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.378234 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writer thread running {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:10:06.378710 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.379285 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.379862 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.380418 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.381022 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.382895 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.383400 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.383923 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.384469 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.385028 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.385576 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.386064 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.386852 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.388653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.388653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.389344 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.390283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.392203 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.392636 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.393066 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.393554 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.394039 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.394751 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.395348 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.395865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.396351 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.398717 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.398717 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.398717 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.398717 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.399428 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.400013 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.400595 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.401213 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.401997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.402628 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.403285 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.404442 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.405567 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.406123 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.406922 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.408249 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.408249 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.408709 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.409237 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.409836 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.410436 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.411042 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.411652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.412203 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.412767 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.413386 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.413949 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.414546 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.415134 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.415717 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.416292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.416856 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.417649 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.418233 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.418860 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.419472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.420086 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.420638 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.421234 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.421852 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.422499 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.423266 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.423840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.424413 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.424990 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.425640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.426164 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.426806 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.427410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.427978 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.428550 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.429127 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.429715 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.430281 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.430956 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.431754 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.432321 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.432926 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.433668 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.434228 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.434881 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.435515 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.436069 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.436667 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.437210 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.437750 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.438333 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.439001 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.439615 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.440189 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.440788 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.441356 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.441971 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.444032 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.444032 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.444032 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.445025 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.445257 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.445759 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.446363 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.447038 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.447709 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.448197 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.448773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.449292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.449841 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.450991 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.451575 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.452157 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.452776 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.453528 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.453883 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.454646 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.455091 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.455651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.456511 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.457105 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.457936 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.458640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.459327 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.460016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.460636 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.461209 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.461786 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.462328 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.463037 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.463822 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.464258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.464769 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.465706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.467096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.467743 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.468363 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.468987 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.469558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.470124 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.470653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.471203 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.471767 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.472289 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.472821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.473358 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.474088 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.474518 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.475096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.475629 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.486389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.486389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.486389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.486389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.486389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.486389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.486389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.486389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.489544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.489544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.489544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.489544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.489544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.489544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.489544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.489544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.491611 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.491611 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.491611 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.491611 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.491611 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.491611 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.491611 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.491611 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.493840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.493840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.493840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.493840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.494823 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.494823 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.495314 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.495661 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.497626 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.497626 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.497626 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.498426 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.498750 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.499272 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.500042 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.500651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.501236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.501840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.502499 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.503101 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.503656 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.504228 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.504800 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.505368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.505936 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.506654 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.507183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.507789 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.508745 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.509326 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.509900 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.510536 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.511406 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.512015 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.513308 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.513866 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.514514 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.515085 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.516348 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.517179 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.518023 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.518706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.519518 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.520043 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.520556 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.521077 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.521617 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.522160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.522858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.523310 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.523858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.524437 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.525003 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.525555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.526126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.526722 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.527765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.528443 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.529553 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.530135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.530753 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.531322 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.531933 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.532455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.533253 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.533523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.534434 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.535025 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.535577 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.536126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.536690 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.537592 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.537883 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.538550 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.539143 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.539657 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.540211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.541066 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.541617 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.542393 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.543102 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.544011 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.544259 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.544626 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.545171 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.545708 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.546242 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.546957 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.547815 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.548100 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.548730 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.549103 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.549672 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.550238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.550840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.551433 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.551978 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.552749 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.553467 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.553977 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.555151 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.555829 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.557145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.558127 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.558894 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.559789 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.560473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.561042 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.561844 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.562749 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.563552 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.564153 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.564409 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.565099 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.565667 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.566400 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.567034 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.567855 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.568457 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.569316 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.569960 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.570638 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.571294 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.571934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.572586 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.573247 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.573968 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.574655 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.575852 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.576497 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.577148 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.577809 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.578576 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.579082 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.579645 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.580289 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.580947 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.581530 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.582094 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.582899 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.583503 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.584159 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.584817 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.585477 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.586146 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.586839 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.587486 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.588146 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.588787 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.589525 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.590143 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.590873 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.592097 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.592711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.593287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.593926 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.594721 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.595336 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.596020 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.596665 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.597293 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.597940 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.598979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.599468 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.600032 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.600722 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.601666 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.602303 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.602992 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.603623 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.604425 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.605020 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.605550 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.606223 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.606941 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.607448 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.607855 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.608264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.608728 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.609311 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.609721 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.610145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.610518 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.610906 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.611324 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.611725 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.612138 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.612552 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.612984 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.613350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.613960 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.614363 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.614814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.615213 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.615755 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.616089 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.616421 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.616782 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.617147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.617439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.617788 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.618123 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.618558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.618810 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.619132 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.619725 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.620335 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.620335 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.620797 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.620797 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.621269 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.621506 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.621745 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.621976 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.622319 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.622675 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.623497 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.623497 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.623980 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.623980 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.624448 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.624716 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.625149 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.625600 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.625848 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.626107 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.626407 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.626781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:10:06.627025 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117911) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:10:06.693942 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO dbcounter [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] Registered counter for database nova_api Aug 03 12:10:06.718604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_db.sqlalchemy.engines [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117911) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:10:06.734300 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writer thread running {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:10:06.761623 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: WARNING keystonemiddleware.auth_token [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:10:06.770213 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: WARNING keystonemiddleware.auth_token [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:10:06.805955 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.context [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b78e12ae-4961-43a7-b06c-67318250b51a(cell1) {{(pid=117911) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 12:10:06.811568 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:10:06.813257 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:10:06.814136 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:10:06.816257 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:10:06.819108 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO dbcounter [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] Registered counter for database nova_cell0 Aug 03 12:10:06.823675 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO dbcounter [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] Registered counter for database nova_cell1 Aug 03 12:10:06.833723 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_db.sqlalchemy.engines [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117911) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:10:06.836922 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_db.sqlalchemy.engines [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117911) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:10:06.845687 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writer thread running {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:10:06.847217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writer thread running {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:10:07.014135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO dbcounter [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] Registered counter for database nova_cell0 Aug 03 12:10:07.024521 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_db.sqlalchemy.engines [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117911) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:10:07.031601 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writer thread running {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:10:07.153462 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: WARNING keystonemiddleware.auth_token [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:10:07.159835 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: WARNING keystonemiddleware.auth_token [None req-402cf34d-bcce-4315-9f3b-87ec193b4264 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:10:07.165416 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55905a7dd9c0 pid: 117910 (default app) Aug 03 12:10:07.393234 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: WARNING keystonemiddleware.auth_token [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:10:07.401286 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: WARNING keystonemiddleware.auth_token [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:10:07.835641 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: WARNING keystonemiddleware.auth_token [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 12:10:07.844515 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: WARNING keystonemiddleware.auth_token [None req-5221b407-be97-4db3-867a-1191a1fafa5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 12:10:07.850826 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55905a7dd9c0 pid: 117911 (default app) Aug 03 12:10:53.895744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:53.896613 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:53.899309 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:53.901058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:55.126183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b00fab02-6c38-4fa5-ace5-6efc8850967f tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] Action: 'create', calling method: .version_select at 0x7f14dd00e5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-592907423", "metadata": {"Type": "work"}}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:10:57.263218 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b00fab02-6c38-4fa5-ace5-6efc8850967f tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.381452 Aug 03 12:10:57.264904 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Aug 3 12:10:53 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3385 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 12:10:58.005316 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6a151b05-1a50-4c49-ad68-9d28d4796247 tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] Calling method '.version_select at 0x7f14dd0c01f0>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:10:58.067552 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=3 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:58.068813 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=3 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:58.069998 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=3 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:58.071559 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=3 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:10:58.677628 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6a151b05-1a50-4c49-ad68-9d28d4796247 tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6e71afff-f58b-45ae-b409-ce8996f27bf3" status: 200 len: 353 microversion: 2.1 time: 1.397069 Aug 03 12:10:58.678932 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 1/2] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 3 12:10:57 2022] GET /compute/v2.1/os-volumes/6e71afff-f58b-45ae-b409-ce8996f27bf3 => generated 353 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:10:58.694292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5964176e-9f90-4c11-b68e-b0c554894e76 tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] Calling method '.version_select at 0x7f14dce614c0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:10:58.846732 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5964176e-9f90-4c11-b68e-b0c554894e76 tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6e71afff-f58b-45ae-b409-ce8996f27bf3" status: 200 len: 353 microversion: 2.1 time: 0.156942 Aug 03 12:10:58.847700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 3 12:10:58 2022] GET /compute/v2.1/os-volumes/6e71afff-f58b-45ae-b409-ce8996f27bf3 => generated 353 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:10:58.867724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-98811c50-a84d-4790-b8e4-b31de5864eb5 tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] Calling method '.version_select at 0x7f14dceb84c0>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:10:59.011463 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-98811c50-a84d-4790-b8e4-b31de5864eb5 tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/6e71afff-f58b-45ae-b409-ce8996f27bf3" status: 202 len: 0 microversion: 2.1 time: 0.148418 Aug 03 12:10:59.017291 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 3 12:10:58 2022] DELETE /compute/v2.1/os-volumes/6e71afff-f58b-45ae-b409-ce8996f27bf3 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:10:59.032232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-17be6631-044b-47d5-be33-0785aa4cea97 tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] Calling method '.version_select at 0x7f14dce61c10>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:10:59.160616 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-17be6631-044b-47d5-be33-0785aa4cea97 tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6e71afff-f58b-45ae-b409-ce8996f27bf3" status: 200 len: 352 microversion: 2.1 time: 0.136612 Aug 03 12:10:59.161510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 3/5] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 3 12:10:59 2022] GET /compute/v2.1/os-volumes/6e71afff-f58b-45ae-b409-ce8996f27bf3 => generated 352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:11:00.178736 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-bbe38f98-35a4-408e-ac8d-12d0faa667e9 tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] Calling method '.version_select at 0x7f14dceb8550>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:00.244464 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-bbe38f98-35a4-408e-ac8d-12d0faa667e9 tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] HTTP exception thrown: Volume 6e71afff-f58b-45ae-b409-ce8996f27bf3 could not be found. Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-bbe38f98-35a4-408e-ac8d-12d0faa667e9 tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] Request method failure captured: Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/os-volumes/6e71afff-f58b-45ae-b409-ce8996f27bf3 HTTP/1.1 Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXNSXHUxfgzbeJ1-0HxpEznsCLAF8jsCvUvzb13L5gALIjtAqZPGawulD0y-0Pio4GkPKGApp5Yje4OMJIwacrd8Nek7ZSY-oI2b9aAE-8ZTfVGG_nxTh3QDFnkyPddYueMbGfeiGMKIGVdD968L9scMwN5FT9mjHjhGZWWalkUARI Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 4366bd8dc8874f489ff79143207d50a4 Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-VolumesGetTestJSON-757522988 Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:11:00.250653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:11:00.251997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4366bd8dc8874f489ff79143207d50a4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4366bd8dc8874f489ff79143207d50a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4366bd8dc8874f489ff79143207d50a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4366bd8dc8874f489ff79143207d50a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:11:00.251997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-VolumesGetTestJSON-757522988 Aug 03 12:11:00.251997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 4366bd8dc8874f489ff79143207d50a4 Aug 03 12:11:00.251997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-VolumesGetTestJSON-757522988 Aug 03 12:11:00.251997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-VolumesGetTestJSON-757522988-project Aug 03 12:11:00.251997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:11:00.251997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:11:00.251997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 647441e1b389429aa7d8fe4ce4936ceb Aug 03 12:11:00.251997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-VolumesGetTestJSON-757522988-project Aug 03 12:11:00.251997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: Aug 03 12:11:00.251997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Volume 6e71afff-f58b-45ae-b409-ce8996f27bf3 could not be found. Aug 03 12:11:00.251997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': '6e71afff-f58b-45ae-b409-ce8996f27bf3'} Aug 03 12:11:00.251997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e71afff-f58b-45ae-b409-ce8996f27bf3 could not be found. (HTTP 404) (Request-ID: req-4043144a-22e4-4775-8fec-652f7ea52137) Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:00.252801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:11:00.253804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e71afff-f58b-45ae-b409-ce8996f27bf3 could not be found. Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 12:11:00.255104 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:11:00.256202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e71afff-f58b-45ae-b409-ce8996f27bf3 could not be found. Aug 03 12:11:00.256202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:00.256202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:00.256202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:00.256202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:00.256202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:00.256202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:00.256202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:11:00.256202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:11:00.256202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e71afff-f58b-45ae-b409-ce8996f27bf3 could not be found. Aug 03 12:11:00.256202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:00.257055 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-bbe38f98-35a4-408e-ac8d-12d0faa667e9 tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] Returning 404 to user: Volume 6e71afff-f58b-45ae-b409-ce8996f27bf3 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:11:00.258716 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-bbe38f98-35a4-408e-ac8d-12d0faa667e9 tempest-VolumesGetTestJSON-757522988 tempest-VolumesGetTestJSON-757522988-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/6e71afff-f58b-45ae-b409-ce8996f27bf3" status: 404 len: 109 microversion: 2.1 time: 0.085817 Aug 03 12:11:00.262168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 3/6] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 3 12:11:00 2022] GET /compute/v2.1/os-volumes/6e71afff-f58b-45ae-b409-ce8996f27bf3 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 12:11:07.981336 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5f287ead-b9ff-4c4e-81c8-c54ec5a2deb2 tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Action: 'create', calling method: .version_select at 0x7f14dce791f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-486343495", "metadata": {"Type": "work"}}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5f287ead-b9ff-4c4e-81c8-c54ec5a2deb2 tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Request method failure captured: Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 121 Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXbTRhzBzltRs1zqrz-1xJ0Io7mVo0lkpvbzfeJpu_2tdWDy3UFhPM1vnGy837gWJXuvr8U1ryEqRFZC8ZCAhp3KHrINoLkwv2ahtSiH6WheO0n2myCsQOmiWa7PmpuOSfuc8sNzZLQlOg26ecNjxf0R5oZuB3kq6OKKNz1Jt-mxHM Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 9df422ac413748369c552de6e43d089e Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:11:08.010058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:11:08.011830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9df422ac413748369c552de6e43d089e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9df422ac413748369c552de6e43d089e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9df422ac413748369c552de6e43d089e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9df422ac413748369c552de6e43d089e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:11:08.011830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.011830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 9df422ac413748369c552de6e43d089e Aug 03 12:11:08.011830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.011830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesNegativeTest-474237208-project Aug 03 12:11:08.011830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:11:08.011830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:11:08.011830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 95901ad361ee452da1e2684a88abdee3 Aug 03 12:11:08.011830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesNegativeTest-474237208-project Aug 03 12:11:08.011830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Aug 03 12:11:08.011830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-486343495", "metadata": {"Type": "work"}}} Aug 03 12:11:08.011830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: Aug 03 12:11:08.011830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-486343495', 'metadata': {'Type': 'work'}}}} Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise error Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi '#$%' Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:11:08.012700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 12:11:08.014055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 12:11:08.016440 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 12:11:08.016440 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.016440 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5f287ead-b9ff-4c4e-81c8-c54ec5a2deb2 tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:11:08.016440 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5f287ead-b9ff-4c4e-81c8-c54ec5a2deb2 tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.324047 Aug 03 12:11:08.027417 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cc21b1fe-9965-492b-8060-152f6cb5e792 tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Action: 'create', calling method: .version_select at 0x7f14dd839a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1620716790", "metadata": {"Type": "work"}}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:08.030257 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 4/7] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Aug 3 12:11:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 343 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cc21b1fe-9965-492b-8060-152f6cb5e792 tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Request method failure captured: Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 120 Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXbTRhzBzltRs1zqrz-1xJ0Io7mVo0lkpvbzfeJpu_2tdWDy3UFhPM1vnGy837gWJXuvr8U1ryEqRFZC8ZCAhp3KHrINoLkwv2ahtSiH6WheO0n2myCsQOmiWa7PmpuOSfuc8sNzZLQlOg26ecNjxf0R5oZuB3kq6OKKNz1Jt-mxHM Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 9df422ac413748369c552de6e43d089e Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:11:08.050147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:11:08.051651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9df422ac413748369c552de6e43d089e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9df422ac413748369c552de6e43d089e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9df422ac413748369c552de6e43d089e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9df422ac413748369c552de6e43d089e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:11:08.051651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.051651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 9df422ac413748369c552de6e43d089e Aug 03 12:11:08.051651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.051651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-VolumesNegativeTest-474237208-project Aug 03 12:11:08.051651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:11:08.051651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:11:08.051651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 95901ad361ee452da1e2684a88abdee3 Aug 03 12:11:08.051651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-VolumesNegativeTest-474237208-project Aug 03 12:11:08.051651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Aug 03 12:11:08.051651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1620716790", "metadata": {"Type": "work"}}} Aug 03 12:11:08.051651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: Aug 03 12:11:08.051651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1620716790', 'metadata': {'Type': 'work'}}}} Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise error Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi '0' Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:11:08.052455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 12:11:08.053814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 12:11:08.055096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 12:11:08.055096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.055096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cc21b1fe-9965-492b-8060-152f6cb5e792 tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:11:08.055096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-cc21b1fe-9965-492b-8060-152f6cb5e792 tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032903 Aug 03 12:11:08.072136 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c54dd8a5-416c-490a-848e-02772e2eea7f tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Action: 'create', calling method: .version_select at 0x7f14dce613a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-796709623", "metadata": {"Type": "work"}}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:08.077571 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 4/8] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Aug 3 12:11:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c54dd8a5-416c-490a-848e-02772e2eea7f tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Request method failure captured: Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 118 Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXbTRhzBzltRs1zqrz-1xJ0Io7mVo0lkpvbzfeJpu_2tdWDy3UFhPM1vnGy837gWJXuvr8U1ryEqRFZC8ZCAhp3KHrINoLkwv2ahtSiH6WheO0n2myCsQOmiWa7PmpuOSfuc8sNzZLQlOg26ecNjxf0R5oZuB3kq6OKKNz1Jt-mxHM Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 9df422ac413748369c552de6e43d089e Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:11:08.090039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:11:08.091466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9df422ac413748369c552de6e43d089e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9df422ac413748369c552de6e43d089e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9df422ac413748369c552de6e43d089e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9df422ac413748369c552de6e43d089e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:11:08.091466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.091466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 9df422ac413748369c552de6e43d089e Aug 03 12:11:08.091466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.091466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesNegativeTest-474237208-project Aug 03 12:11:08.091466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:11:08.091466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:11:08.091466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 95901ad361ee452da1e2684a88abdee3 Aug 03 12:11:08.091466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesNegativeTest-474237208-project Aug 03 12:11:08.091466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Aug 03 12:11:08.091466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-796709623", "metadata": {"Type": "work"}}} Aug 03 12:11:08.091466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: Aug 03 12:11:08.091466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-796709623', 'metadata': {'Type': 'work'}}}} Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise error Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi '' Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:11:08.092386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 12:11:08.093649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 12:11:08.094880 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 12:11:08.094880 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.097554 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c54dd8a5-416c-490a-848e-02772e2eea7f tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:11:08.100671 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c54dd8a5-416c-490a-848e-02772e2eea7f tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.038828 Aug 03 12:11:08.106809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 5/9] 10.222.0.17 () {60 vars in 1156 bytes} [Wed Aug 3 12:11:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 12:11:08.131039 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ff09afab-7d84-4f3a-a33f-dcb352700104 tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Calling method '.version_select at 0x7f14dceb8a60>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:08.185190 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-ff09afab-7d84-4f3a-a33f-dcb352700104 tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] HTTP exception thrown: Volume tempest-invalid-1972248005 could not be found. Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ff09afab-7d84-4f3a-a33f-dcb352700104 tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Request method failure captured: Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1972248005 HTTP/1.1 Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXbTRhzBzltRs1zqrz-1xJ0Io7mVo0lkpvbzfeJpu_2tdWDy3UFhPM1vnGy837gWJXuvr8U1ryEqRFZC8ZCAhp3KHrINoLkwv2ahtSiH6WheO0n2myCsQOmiWa7PmpuOSfuc8sNzZLQlOg26ecNjxf0R5oZuB3kq6OKKNz1Jt-mxHM Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 9df422ac413748369c552de6e43d089e Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:11:08.189495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:11:08.190864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9df422ac413748369c552de6e43d089e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9df422ac413748369c552de6e43d089e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9df422ac413748369c552de6e43d089e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9df422ac413748369c552de6e43d089e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:11:08.190864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.190864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 9df422ac413748369c552de6e43d089e Aug 03 12:11:08.190864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.190864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-VolumesNegativeTest-474237208-project Aug 03 12:11:08.190864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:11:08.190864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:11:08.190864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 95901ad361ee452da1e2684a88abdee3 Aug 03 12:11:08.190864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-VolumesNegativeTest-474237208-project Aug 03 12:11:08.190864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: Aug 03 12:11:08.190864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Volume tempest-invalid-1972248005 could not be found. Aug 03 12:11:08.190864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'tempest-invalid-1972248005'} Aug 03 12:11:08.190864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1972248005 could not be found. (HTTP 404) (Request-ID: req-f2828fe1-4039-467e-8dfa-dabd28a4b785) Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.191765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 12:11:08.197092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1972248005 could not be found. Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:11:08.198217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1972248005 could not be found. Aug 03 12:11:08.199396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.199396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.199396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.199396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.199396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:08.199396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:08.199396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:11:08.199396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:11:08.199396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1972248005 could not be found. Aug 03 12:11:08.199396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.199396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ff09afab-7d84-4f3a-a33f-dcb352700104 tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Returning 404 to user: Volume tempest-invalid-1972248005 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:11:08.199396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ff09afab-7d84-4f3a-a33f-dcb352700104 tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1972248005" status: 404 len: 99 microversion: 2.1 time: 0.079396 Aug 03 12:11:08.199396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 5/10] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Aug 3 12:11:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1972248005 => generated 99 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 03 12:11:08.202765 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-23e4a98b-5268-41ff-acad-edc6b4cd095d tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005183 Aug 03 12:11:08.208063 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 6/11] 10.222.0.17 () {58 vars in 1140 bytes} [Wed Aug 3 12:11:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 12:11:08.231974 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6e981f61-02da-46d5-b463-202144ace38a tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.021412 Aug 03 12:11:08.244802 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-48bb4464-0af0-4895-99ec-408f8d1e648b tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Calling method '.version_select at 0x7f14dce61820>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:08.248800 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1137 bytes} [Wed Aug 3 12:11:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 12:11:08.329400 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-48bb4464-0af0-4895-99ec-408f8d1e648b tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] HTTP exception thrown: Volume b5a54c76-4d8b-44f4-b0f7-4af7da2ab864 could not be found. Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-48bb4464-0af0-4895-99ec-408f8d1e648b tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Request method failure captured: Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: DELETE /compute/v2.1/os-volumes/b5a54c76-4d8b-44f4-b0f7-4af7da2ab864 HTTP/1.1 Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXbTRhzBzltRs1zqrz-1xJ0Io7mVo0lkpvbzfeJpu_2tdWDy3UFhPM1vnGy837gWJXuvr8U1ryEqRFZC8ZCAhp3KHrINoLkwv2ahtSiH6WheO0n2myCsQOmiWa7PmpuOSfuc8sNzZLQlOg26ecNjxf0R5oZuB3kq6OKKNz1Jt-mxHM Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 9df422ac413748369c552de6e43d089e Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:11:08.333068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:11:08.335799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9df422ac413748369c552de6e43d089e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9df422ac413748369c552de6e43d089e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9df422ac413748369c552de6e43d089e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9df422ac413748369c552de6e43d089e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:11:08.335799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.335799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 9df422ac413748369c552de6e43d089e Aug 03 12:11:08.335799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.335799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesNegativeTest-474237208-project Aug 03 12:11:08.335799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:11:08.335799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:11:08.335799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 95901ad361ee452da1e2684a88abdee3 Aug 03 12:11:08.335799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesNegativeTest-474237208-project Aug 03 12:11:08.335799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: Aug 03 12:11:08.335799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Volume b5a54c76-4d8b-44f4-b0f7-4af7da2ab864 could not be found. Aug 03 12:11:08.335799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'b5a54c76-4d8b-44f4-b0f7-4af7da2ab864'} Aug 03 12:11:08.335799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5a54c76-4d8b-44f4-b0f7-4af7da2ab864 could not be found. (HTTP 404) (Request-ID: req-ca181351-93ce-4598-a98e-0fcc641b6f1d) Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.337672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 12:11:08.341735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5a54c76-4d8b-44f4-b0f7-4af7da2ab864 could not be found. Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 12:11:08.346164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5a54c76-4d8b-44f4-b0f7-4af7da2ab864 could not be found. Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5a54c76-4d8b-44f4-b0f7-4af7da2ab864 could not be found. Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-48bb4464-0af0-4895-99ec-408f8d1e648b tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Returning 404 to user: Volume b5a54c76-4d8b-44f4-b0f7-4af7da2ab864 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-48bb4464-0af0-4895-99ec-408f8d1e648b tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/b5a54c76-4d8b-44f4-b0f7-4af7da2ab864" status: 404 len: 109 microversion: 2.1 time: 0.095808 Aug 03 12:11:08.350620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 3 12:11:08 2022] DELETE /compute/v2.1/os-volumes/b5a54c76-4d8b-44f4-b0f7-4af7da2ab864 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:11:08.361715 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-01a8d17a-86dd-4470-8d6e-3160e7a34ace tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Calling method '.version_select at 0x7f14dd839940>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:08.429088 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-01a8d17a-86dd-4470-8d6e-3160e7a34ace tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] HTTP exception thrown: Volume e1e9a2cd-9476-43d4-99f0-683ccc29937f could not be found. Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-01a8d17a-86dd-4470-8d6e-3160e7a34ace tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Request method failure captured: Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/os-volumes/e1e9a2cd-9476-43d4-99f0-683ccc29937f HTTP/1.1 Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXbTRhzBzltRs1zqrz-1xJ0Io7mVo0lkpvbzfeJpu_2tdWDy3UFhPM1vnGy837gWJXuvr8U1ryEqRFZC8ZCAhp3KHrINoLkwv2ahtSiH6WheO0n2myCsQOmiWa7PmpuOSfuc8sNzZLQlOg26ecNjxf0R5oZuB3kq6OKKNz1Jt-mxHM Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 9df422ac413748369c552de6e43d089e Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:11:08.431305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:11:08.433604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9df422ac413748369c552de6e43d089e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9df422ac413748369c552de6e43d089e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9df422ac413748369c552de6e43d089e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9df422ac413748369c552de6e43d089e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:11:08.433604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.433604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 9df422ac413748369c552de6e43d089e Aug 03 12:11:08.433604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-VolumesNegativeTest-474237208 Aug 03 12:11:08.433604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-VolumesNegativeTest-474237208-project Aug 03 12:11:08.433604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:11:08.433604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:11:08.433604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 95901ad361ee452da1e2684a88abdee3 Aug 03 12:11:08.433604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-VolumesNegativeTest-474237208-project Aug 03 12:11:08.433604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: Aug 03 12:11:08.433604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Volume e1e9a2cd-9476-43d4-99f0-683ccc29937f could not be found. Aug 03 12:11:08.433604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'e1e9a2cd-9476-43d4-99f0-683ccc29937f'} Aug 03 12:11:08.433604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1e9a2cd-9476-43d4-99f0-683ccc29937f could not be found. (HTTP 404) (Request-ID: req-e1bd8ff0-70bd-4759-a5e2-e1bdb4b279dc) Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.435188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:11:08.437439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1e9a2cd-9476-43d4-99f0-683ccc29937f could not be found. Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 12:11:08.440187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:11:08.442036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1e9a2cd-9476-43d4-99f0-683ccc29937f could not be found. Aug 03 12:11:08.442036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.442036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:11:08.442036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.442036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:11:08.442036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:11:08.442036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:11:08.442036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:11:08.442036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:11:08.442036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1e9a2cd-9476-43d4-99f0-683ccc29937f could not be found. Aug 03 12:11:08.442036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:11:08.442036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-01a8d17a-86dd-4470-8d6e-3160e7a34ace tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] Returning 404 to user: Volume e1e9a2cd-9476-43d4-99f0-683ccc29937f could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:11:08.442036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-01a8d17a-86dd-4470-8d6e-3160e7a34ace tempest-VolumesNegativeTest-474237208 tempest-VolumesNegativeTest-474237208-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e1e9a2cd-9476-43d4-99f0-683ccc29937f" status: 404 len: 109 microversion: 2.1 time: 0.091517 Aug 03 12:11:08.448445 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 7/14] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 3 12:11:08 2022] GET /compute/v2.1/os-volumes/e1e9a2cd-9476-43d4-99f0-683ccc29937f => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:11:10.196861 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-13fc2e4e-63bd-4e3b-b4f4-366f4a48a0e8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Action: 'create', calling method: .version_select at 0x7f14dce37c10>, body: {"keypair": {"name": "tempest-keypair-1748066561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvVomlbsSZjJzMgfVKpMB6aRRNcOVRn9nTG0RmpCKkRVkUJTBCaKGRbIpSF9Lu6KWQRlGv+gmQyf7LonTSFVKCTN6jVFcKZx6Jwyfbh4G986vKyjavaKUHaoL3Gtq56GA=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:10.313850 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-13fc2e4e-63bd-4e3b-b4f4-366f4a48a0e8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:11:10.333499 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-13fc2e4e-63bd-4e3b-b4f4-366f4a48a0e8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for user e7566583228946488bd1ab647bbe8059 and project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:11:10.470730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-13fc2e4e-63bd-4e3b-b4f4-366f4a48a0e8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.634429 Aug 03 12:11:10.472084 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 8/15] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 3 12:11:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:11:14.813132 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b99b7235-e702-416c-a770-e531062f048b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Action: 'create', calling method: .version_select at 0x7f14dceb8a60>, body: {"keypair": {"name": "tempest-keypair-1388041272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsNjBShY6Mw0fERi31i9Ge2KgzbOWacngQrlf6zDp+2u1uX9sWN8P+YLrARdPyuKGXqL/mqAHalP0W4azYm/EPgngoFag4wfyeVGexBVzy49pmE76lek3eaGiDmqGNWeA=="}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:14.938511 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-b99b7235-e702-416c-a770-e531062f048b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Getting quotas for project fbbed7fab4584f379dbefe4af9826544. Resources: {'key_pairs'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:11:14.955613 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-b99b7235-e702-416c-a770-e531062f048b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Getting quotas for user 42ce2627c0f142f8892c182f69ef9a39 and project fbbed7fab4584f379dbefe4af9826544. Resources: {'key_pairs'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:11:15.092761 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b99b7235-e702-416c-a770-e531062f048b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.033659 Aug 03 12:11:15.111333 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 8/16] 10.222.0.17 () {62 vars in 1200 bytes} [Wed Aug 3 12:11:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1053 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 12:11:17.847355 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1530462081", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a64e775-73b7-4e56-9c06-9163d23fd664"}], "security_groups": [{"name": "tempest-securitygroup--1600264886"}], "key_name": "tempest-keypair-1748066561", "user_data": "}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:19.084724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] validate_networks() for [('5a64e775-73b7-4e56-9c06-9163d23fd664', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:11:20.357817 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=4 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:23.512424 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-85389123", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:23.656091 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:11:23.658645 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:11:23.659780 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:11:23.660728 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:11:23.666250 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:11:23.688514 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.network.neutron [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] validate_networks() for [('b7338a33-290c-4a93-9bd8-57cfb66ce3d7', None, None, None, None, None)] {{(pid=117911) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:11:23.702897 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:23.725906 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:23.727554 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:23.728343 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:23.838851 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:11:23.865637 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for user e7566583228946488bd1ab647bbe8059 and project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:11:23.926151 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:11:23.933677 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:11:24.170715 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-fdfda8d9-1dcc-44cd-b3ea-e5bbd594d845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.365507 Aug 03 12:11:24.180388 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 9/17] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:11:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 6377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:11:24.972493 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=4 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:25.380521 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-396116114", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "networks": [{"uuid": "bb8f16fe-17e5-4f0a-987e-82e67ac5b5c7"}]}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:25.518703 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] validate_networks() for [('bb8f16fe-17e5-4f0a-987e-82e67ac5b5c7', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:11:27.019953 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:11:27.021270 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:11:27.021969 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:11:27.022590 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:11:27.023300 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:11:27.043545 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:27.047326 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:27.048878 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:27.051958 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:27.117102 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Flavor limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:11:27.117815 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Image limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:11:27.117815 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Flavor pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:11:27.118095 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Image pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:11:27.118800 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:11:27.143044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Getting quotas for project 76ff7a3700a24217bcd8474d46717c92. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:11:27.149784 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:27.155150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:27.161702 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:27.163613 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Getting quotas for user 9e0305cbb5a9491c85a89d0b40cb821a and project 76ff7a3700a24217bcd8474d46717c92. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:11:27.167952 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:27.253745 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:11:27.272288 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:11:27.285195 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Getting quotas for project d51be67fb4974085b55f3dcfcc2c70aa. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:11:27.299592 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Getting quotas for user cde9db32ba1c4810833f8fd824536347 and project d51be67fb4974085b55f3dcfcc2c70aa. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:11:27.336343 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Going to run 1 instances... {{(pid=117911) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:11:27.341382 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:11:27.569644 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-24b31539-274a-4ca2-8035-ad201918312d tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.387508 Aug 03 12:11:27.571476 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 10/18] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:11:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:11:27.591108 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-69bfd650-c04d-4a20-a127-bbd4caf78d5c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.856198 Aug 03 12:11:27.593005 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1476641846", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d3355728-01c2-4642-be6b-47d847609cf2"}], "security_groups": [{"name": "tempest-securitygroup--599911321"}], "key_name": "tempest-keypair-1388041272", "user_data": "}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:27.595245 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 9/19] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:11:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 4861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:11:27.629974 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6a8c0ec5-c22d-47db-8abc-045fc00b9b2c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:27.645131 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-6a8c0ec5-c22d-47db-8abc-045fc00b9b2c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:27.731386 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6a8c0ec5-c22d-47db-8abc-045fc00b9b2c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:27.732073 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6a8c0ec5-c22d-47db-8abc-045fc00b9b2c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:27.733345 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6a8c0ec5-c22d-47db-8abc-045fc00b9b2c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:27.734121 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6a8c0ec5-c22d-47db-8abc-045fc00b9b2c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:28.090948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] validate_networks() for [('d3355728-01c2-4642-be6b-47d847609cf2', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:11:28.478002 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-6a8c0ec5-c22d-47db-8abc-045fc00b9b2c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:28.573143 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6a8c0ec5-c22d-47db-8abc-045fc00b9b2c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1246 microversion: 2.1 time: 0.964992 Aug 03 12:11:28.590538 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 10/20] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:27 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1246 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:28.626975 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-8e6810ed-529e-4a15-93e0-2ce79f81e9b5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:28.631000 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-8e6810ed-529e-4a15-93e0-2ce79f81e9b5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:28.915748 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-8e6810ed-529e-4a15-93e0-2ce79f81e9b5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:29.008600 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-8e6810ed-529e-4a15-93e0-2ce79f81e9b5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1214 microversion: 2.1 time: 0.425522 Aug 03 12:11:29.009649 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 11/21] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:28 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1214 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:29.079032 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-086979e8-e4ee-4583-9ab5-ad3dc5e2e51c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:29.083966 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-086979e8-e4ee-4583-9ab5-ad3dc5e2e51c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:29.385489 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-086979e8-e4ee-4583-9ab5-ad3dc5e2e51c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:29.397398 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-086979e8-e4ee-4583-9ab5-ad3dc5e2e51c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1220 microversion: 2.1 time: 0.386137 Aug 03 12:11:29.410825 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 12/22] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:29 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1220 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:29.602726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:11:29.603497 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:11:29.604353 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:11:29.605159 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:11:29.605904 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:11:29.622185 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-fccebd96-f0e1-47c1-83fc-a927930e837f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:29.623466 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-fccebd96-f0e1-47c1-83fc-a927930e837f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:29.633492 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fccebd96-f0e1-47c1-83fc-a927930e837f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:29.634368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fccebd96-f0e1-47c1-83fc-a927930e837f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:29.636560 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fccebd96-f0e1-47c1-83fc-a927930e837f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:29.643110 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fccebd96-f0e1-47c1-83fc-a927930e837f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:29.659216 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:29.660046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:29.669162 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:29.673075 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:29.743991 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Getting quotas for project fbbed7fab4584f379dbefe4af9826544. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:11:29.753521 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Getting quotas for user 42ce2627c0f142f8892c182f69ef9a39 and project fbbed7fab4584f379dbefe4af9826544. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:11:29.811347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:11:29.815437 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:11:29.835909 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-fccebd96-f0e1-47c1-83fc-a927930e837f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:29.852107 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-fccebd96-f0e1-47c1-83fc-a927930e837f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1246 microversion: 2.1 time: 0.233255 Aug 03 12:11:29.853334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 13/23] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:29 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1246 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:29.878424 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1506981095", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:29.911753 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2872bcc8-ee18-4f62-8e46-5c82729c0454 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.338307 Aug 03 12:11:29.913347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 11/24] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Aug 3 12:11:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 2341 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 12:11:29.961814 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3a221222-8ebd-425c-8bfc-667e19f56d00 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:29.964400 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3a221222-8ebd-425c-8bfc-667e19f56d00 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:30.014103 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.network.neutron [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] validate_networks() for [('b7338a33-290c-4a93-9bd8-57cfb66ce3d7', None, None, None, None, None)] {{(pid=117911) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:11:30.393919 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3a221222-8ebd-425c-8bfc-667e19f56d00 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:30.435369 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3a221222-8ebd-425c-8bfc-667e19f56d00 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:30.440443 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3a221222-8ebd-425c-8bfc-667e19f56d00 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:30.444445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3a221222-8ebd-425c-8bfc-667e19f56d00 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1282 microversion: 2.20 time: 0.522816 Aug 03 12:11:30.447412 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 12/25] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:29 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1282 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:30.465333 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-17e8f432-203a-46aa-b48d-139a2457062f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:30.466935 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-17e8f432-203a-46aa-b48d-139a2457062f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:30.568947 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17e8f432-203a-46aa-b48d-139a2457062f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:30.570300 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17e8f432-203a-46aa-b48d-139a2457062f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:30.572118 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17e8f432-203a-46aa-b48d-139a2457062f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:30.573435 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17e8f432-203a-46aa-b48d-139a2457062f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:31.446024 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-17e8f432-203a-46aa-b48d-139a2457062f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:31.526248 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-17e8f432-203a-46aa-b48d-139a2457062f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1218 microversion: 2.1 time: 1.076085 Aug 03 12:11:31.587502 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 13/26] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:30 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1218 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:31.603085 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4b01a8d9-06fb-4f2a-bad2-ebc644e86071 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:31.603727 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4b01a8d9-06fb-4f2a-bad2-ebc644e86071 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:31.622967 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b01a8d9-06fb-4f2a-bad2-ebc644e86071 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:31.623660 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b01a8d9-06fb-4f2a-bad2-ebc644e86071 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:31.624635 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b01a8d9-06fb-4f2a-bad2-ebc644e86071 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:31.625248 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b01a8d9-06fb-4f2a-bad2-ebc644e86071 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:32.004413 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4b01a8d9-06fb-4f2a-bad2-ebc644e86071 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:32.029990 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4b01a8d9-06fb-4f2a-bad2-ebc644e86071 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1294 microversion: 2.1 time: 0.437667 Aug 03 12:11:32.031872 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 14/27] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:31 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1294 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:32.039677 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-12fd69e1-00a0-4ed2-9f55-f619ff16de28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:32.044631 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-12fd69e1-00a0-4ed2-9f55-f619ff16de28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:32.074802 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-12fd69e1-00a0-4ed2-9f55-f619ff16de28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:32.077559 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-12fd69e1-00a0-4ed2-9f55-f619ff16de28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:32.078740 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-12fd69e1-00a0-4ed2-9f55-f619ff16de28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:32.079416 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-12fd69e1-00a0-4ed2-9f55-f619ff16de28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:32.102763 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Flavor limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:11:32.103494 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Image limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:11:32.104377 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Flavor pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:11:32.105695 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Image pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:11:32.106496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:11:32.161183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:32.162027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:32.163118 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:32.163783 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:32.246105 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Getting quotas for project d51be67fb4974085b55f3dcfcc2c70aa. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:11:32.280059 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Getting quotas for user cde9db32ba1c4810833f8fd824536347 and project d51be67fb4974085b55f3dcfcc2c70aa. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:11:32.354314 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Going to run 1 instances... {{(pid=117911) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:11:32.359154 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:11:32.447973 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-12fd69e1-00a0-4ed2-9f55-f619ff16de28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:32.489778 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-12fd69e1-00a0-4ed2-9f55-f619ff16de28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:32.505193 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-12fd69e1-00a0-4ed2-9f55-f619ff16de28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:32.509815 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-38069d88-724b-44fa-a3f6-d75dc8302f9e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.652701 Aug 03 12:11:32.512366 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-12fd69e1-00a0-4ed2-9f55-f619ff16de28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1278 microversion: 2.20 time: 0.478863 Aug 03 12:11:32.516982 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 14/28] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:11:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:11:32.520765 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 15/29] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:32 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1278 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:32.545331 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-747a805e-30a8-42f2-b1c4-a22f52f9562d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:32.549571 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-747a805e-30a8-42f2-b1c4-a22f52f9562d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:32.605510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2c7d2771-8cf9-425b-9ad3-66d8b868d1c2 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:32.606814 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2c7d2771-8cf9-425b-9ad3-66d8b868d1c2 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:32.667930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c7d2771-8cf9-425b-9ad3-66d8b868d1c2 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:32.681634 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c7d2771-8cf9-425b-9ad3-66d8b868d1c2 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:32.687690 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c7d2771-8cf9-425b-9ad3-66d8b868d1c2 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:32.694492 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c7d2771-8cf9-425b-9ad3-66d8b868d1c2 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:32.917528 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-747a805e-30a8-42f2-b1c4-a22f52f9562d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:32.925758 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-747a805e-30a8-42f2-b1c4-a22f52f9562d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1222 microversion: 2.1 time: 0.395326 Aug 03 12:11:32.928812 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 15/30] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:32 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1222 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:33.056257 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f3d78d16-0d23-4922-aa9f-cb06eddb742b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:33.057868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f3d78d16-0d23-4922-aa9f-cb06eddb742b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:33.097080 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f3d78d16-0d23-4922-aa9f-cb06eddb742b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:33.105669 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f3d78d16-0d23-4922-aa9f-cb06eddb742b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:33.108299 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f3d78d16-0d23-4922-aa9f-cb06eddb742b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:33.116706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f3d78d16-0d23-4922-aa9f-cb06eddb742b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:33.364439 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2c7d2771-8cf9-425b-9ad3-66d8b868d1c2 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:33.411296 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2c7d2771-8cf9-425b-9ad3-66d8b868d1c2 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1266 microversion: 2.1 time: 0.813646 Aug 03 12:11:33.412324 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 16/31] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:32 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1266 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:33.549893 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e2a6bf86-fb17-4a64-9d3f-ef2e5bef29c0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:33.553892 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e2a6bf86-fb17-4a64-9d3f-ef2e5bef29c0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:33.600910 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2a6bf86-fb17-4a64-9d3f-ef2e5bef29c0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:33.601668 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2a6bf86-fb17-4a64-9d3f-ef2e5bef29c0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:33.603126 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2a6bf86-fb17-4a64-9d3f-ef2e5bef29c0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:33.603938 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e2a6bf86-fb17-4a64-9d3f-ef2e5bef29c0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:34.107014 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e2a6bf86-fb17-4a64-9d3f-ef2e5bef29c0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:34.142116 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e2a6bf86-fb17-4a64-9d3f-ef2e5bef29c0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:34.180671 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e2a6bf86-fb17-4a64-9d3f-ef2e5bef29c0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:34.188432 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e2a6bf86-fb17-4a64-9d3f-ef2e5bef29c0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1334 microversion: 2.20 time: 0.646434 Aug 03 12:11:34.192540 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 17/32] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:33 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1334 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:34.206057 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4a951df5-2780-4250-9dee-6c9503a98885 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:34.207615 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4a951df5-2780-4250-9dee-6c9503a98885 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:34.599243 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4a951df5-2780-4250-9dee-6c9503a98885 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:34.626954 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4a951df5-2780-4250-9dee-6c9503a98885 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1222 microversion: 2.1 time: 0.428229 Aug 03 12:11:34.655008 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 18/33] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:34 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1222 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:34.671648 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3e0404a2-5f10-4179-be3d-0ae02e84156b tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:34.673361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3e0404a2-5f10-4179-be3d-0ae02e84156b tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:34.687129 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3e0404a2-5f10-4179-be3d-0ae02e84156b tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:34.688447 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3e0404a2-5f10-4179-be3d-0ae02e84156b tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:34.690332 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3e0404a2-5f10-4179-be3d-0ae02e84156b tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:34.694461 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3e0404a2-5f10-4179-be3d-0ae02e84156b tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:35.112996 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f3d78d16-0d23-4922-aa9f-cb06eddb742b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:35.144677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f3d78d16-0d23-4922-aa9f-cb06eddb742b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1302 microversion: 2.1 time: 2.094630 Aug 03 12:11:35.145536 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 16/34] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:33 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1302 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:35.249307 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a73efba4-66bc-4e64-ac49-5958e25f985c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:35.253941 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a73efba4-66bc-4e64-ac49-5958e25f985c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:35.295001 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a73efba4-66bc-4e64-ac49-5958e25f985c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:35.299107 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a73efba4-66bc-4e64-ac49-5958e25f985c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:35.310108 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a73efba4-66bc-4e64-ac49-5958e25f985c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:35.311757 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a73efba4-66bc-4e64-ac49-5958e25f985c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:35.505903 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3e0404a2-5f10-4179-be3d-0ae02e84156b tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:35.525099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3e0404a2-5f10-4179-be3d-0ae02e84156b tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1272 microversion: 2.1 time: 0.867776 Aug 03 12:11:35.539504 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 19/35] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:34 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1272 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:35.642812 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a73efba4-66bc-4e64-ac49-5958e25f985c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:35.679383 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3515db62-db33-4055-99db-867789c5cea9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:35.680479 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3515db62-db33-4055-99db-867789c5cea9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:35.689046 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a73efba4-66bc-4e64-ac49-5958e25f985c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:35.697986 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a73efba4-66bc-4e64-ac49-5958e25f985c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:35.699299 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a73efba4-66bc-4e64-ac49-5958e25f985c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1340 microversion: 2.20 time: 0.461457 Aug 03 12:11:35.700200 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 17/36] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:35 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1340 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:35.737957 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3515db62-db33-4055-99db-867789c5cea9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:35.738915 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3515db62-db33-4055-99db-867789c5cea9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:35.740044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3515db62-db33-4055-99db-867789c5cea9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:35.740693 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3515db62-db33-4055-99db-867789c5cea9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:36.173444 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4cccff24-5441-493e-8aba-8759150cd196 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:36.174213 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-4cccff24-5441-493e-8aba-8759150cd196 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:36.188194 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4cccff24-5441-493e-8aba-8759150cd196 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:36.188670 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4cccff24-5441-493e-8aba-8759150cd196 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:36.189482 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4cccff24-5441-493e-8aba-8759150cd196 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:36.202651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4cccff24-5441-493e-8aba-8759150cd196 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:36.466395 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-4cccff24-5441-493e-8aba-8759150cd196 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:36.506836 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-4cccff24-5441-493e-8aba-8759150cd196 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1300 microversion: 2.1 time: 0.339091 Aug 03 12:11:36.522001 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 18/37] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:36 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1300 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:36.539315 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3515db62-db33-4055-99db-867789c5cea9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:36.561913 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-32f3d57e-a619-4c80-b067-5aabf0512c67 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:36.562887 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-32f3d57e-a619-4c80-b067-5aabf0512c67 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:36.563565 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3515db62-db33-4055-99db-867789c5cea9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1274 microversion: 2.1 time: 0.892477 Aug 03 12:11:36.571101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 20/38] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:35 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1274 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:36.578261 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32f3d57e-a619-4c80-b067-5aabf0512c67 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:36.578772 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32f3d57e-a619-4c80-b067-5aabf0512c67 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:36.579594 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32f3d57e-a619-4c80-b067-5aabf0512c67 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:36.582588 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32f3d57e-a619-4c80-b067-5aabf0512c67 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:36.738966 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-912a5951-6f85-4411-a94f-e782d098b79f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:36.739962 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-912a5951-6f85-4411-a94f-e782d098b79f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:36.758934 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-912a5951-6f85-4411-a94f-e782d098b79f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:36.759393 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-912a5951-6f85-4411-a94f-e782d098b79f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:36.761731 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-912a5951-6f85-4411-a94f-e782d098b79f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:36.762179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-912a5951-6f85-4411-a94f-e782d098b79f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:36.777797 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-32f3d57e-a619-4c80-b067-5aabf0512c67 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:36.799538 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-32f3d57e-a619-4c80-b067-5aabf0512c67 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1272 microversion: 2.1 time: 0.244003 Aug 03 12:11:36.801528 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 19/39] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:36 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:37.165644 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-912a5951-6f85-4411-a94f-e782d098b79f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:37.191075 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-912a5951-6f85-4411-a94f-e782d098b79f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:37.195061 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-912a5951-6f85-4411-a94f-e782d098b79f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:37.197926 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-912a5951-6f85-4411-a94f-e782d098b79f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1340 microversion: 2.20 time: 0.462555 Aug 03 12:11:37.200256 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:36 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1340 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:37.574797 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-463f0d8d-8a85-4027-96ec-5a5aef6308af tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:37.581142 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-463f0d8d-8a85-4027-96ec-5a5aef6308af tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:37.604054 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-463f0d8d-8a85-4027-96ec-5a5aef6308af tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:37.605097 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-463f0d8d-8a85-4027-96ec-5a5aef6308af tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:37.608360 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-463f0d8d-8a85-4027-96ec-5a5aef6308af tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:37.610654 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-463f0d8d-8a85-4027-96ec-5a5aef6308af tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:37.620468 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9ab0b287-3724-44d0-ab73-598bc8e21820 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:37.621131 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9ab0b287-3724-44d0-ab73-598bc8e21820 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:37.633244 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9ab0b287-3724-44d0-ab73-598bc8e21820 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:37.633799 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9ab0b287-3724-44d0-ab73-598bc8e21820 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:37.634681 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9ab0b287-3724-44d0-ab73-598bc8e21820 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:37.642708 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9ab0b287-3724-44d0-ab73-598bc8e21820 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:37.771990 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-463f0d8d-8a85-4027-96ec-5a5aef6308af tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:37.786162 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-463f0d8d-8a85-4027-96ec-5a5aef6308af tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1300 microversion: 2.1 time: 0.229515 Aug 03 12:11:37.787223 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 20/41] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:37 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1300 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:37.787914 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9ab0b287-3724-44d0-ab73-598bc8e21820 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:37.804074 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9ab0b287-3724-44d0-ab73-598bc8e21820 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1274 microversion: 2.1 time: 0.187750 Aug 03 12:11:37.818727 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 22/42] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:37 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:37.836422 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-948a8bf9-b33e-42a3-8ec6-d278fd2abd99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:37.836970 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-948a8bf9-b33e-42a3-8ec6-d278fd2abd99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:37.846067 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-948a8bf9-b33e-42a3-8ec6-d278fd2abd99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:37.846703 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-948a8bf9-b33e-42a3-8ec6-d278fd2abd99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:37.847352 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-948a8bf9-b33e-42a3-8ec6-d278fd2abd99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:37.847797 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-948a8bf9-b33e-42a3-8ec6-d278fd2abd99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:38.231136 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-635fef5e-d4d1-42cb-94ba-71f0f6251ae2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:38.232271 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-635fef5e-d4d1-42cb-94ba-71f0f6251ae2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:38.243630 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:38.254846 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-948a8bf9-b33e-42a3-8ec6-d278fd2abd99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:38.269756 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-948a8bf9-b33e-42a3-8ec6-d278fd2abd99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.437394 Aug 03 12:11:38.273600 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-635fef5e-d4d1-42cb-94ba-71f0f6251ae2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:38.276254 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 21/43] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:37 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:38.281532 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-635fef5e-d4d1-42cb-94ba-71f0f6251ae2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:38.284647 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-635fef5e-d4d1-42cb-94ba-71f0f6251ae2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:38.287145 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-635fef5e-d4d1-42cb-94ba-71f0f6251ae2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:38.449290 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-635fef5e-d4d1-42cb-94ba-71f0f6251ae2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:38.515519 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-635fef5e-d4d1-42cb-94ba-71f0f6251ae2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:38.523169 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-635fef5e-d4d1-42cb-94ba-71f0f6251ae2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:38.525930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-635fef5e-d4d1-42cb-94ba-71f0f6251ae2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1340 microversion: 2.20 time: 0.302521 Aug 03 12:11:38.529030 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:38 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1340 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:38.842311 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cedf4b6f-4347-4d44-a810-52a40e219ff8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:38.843425 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cedf4b6f-4347-4d44-a810-52a40e219ff8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:38.846057 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-04929d8e-3eb0-419d-8122-3aca788dcc2d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:38.850629 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-04929d8e-3eb0-419d-8122-3aca788dcc2d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:38.918880 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:38.938847 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cedf4b6f-4347-4d44-a810-52a40e219ff8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:38.940479 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-04929d8e-3eb0-419d-8122-3aca788dcc2d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:38.942403 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cedf4b6f-4347-4d44-a810-52a40e219ff8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:38.944948 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-04929d8e-3eb0-419d-8122-3aca788dcc2d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:38.950269 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cedf4b6f-4347-4d44-a810-52a40e219ff8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:38.951282 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cedf4b6f-4347-4d44-a810-52a40e219ff8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:38.954776 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-04929d8e-3eb0-419d-8122-3aca788dcc2d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:38.955813 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-04929d8e-3eb0-419d-8122-3aca788dcc2d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:39.313873 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-04929d8e-3eb0-419d-8122-3aca788dcc2d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:39.351063 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-04929d8e-3eb0-419d-8122-3aca788dcc2d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1300 microversion: 2.1 time: 0.528850 Aug 03 12:11:39.363040 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 22/45] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:38 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1300 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:39.387403 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-efd50f14-2584-4dbb-8eb6-ce424cd69b0a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:39.388513 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-efd50f14-2584-4dbb-8eb6-ce424cd69b0a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:39.416479 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-efd50f14-2584-4dbb-8eb6-ce424cd69b0a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:39.428116 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-efd50f14-2584-4dbb-8eb6-ce424cd69b0a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:39.429651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-efd50f14-2584-4dbb-8eb6-ce424cd69b0a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:39.430470 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-efd50f14-2584-4dbb-8eb6-ce424cd69b0a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:39.711458 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:40.046725 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cedf4b6f-4347-4d44-a810-52a40e219ff8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:40.061041 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cedf4b6f-4347-4d44-a810-52a40e219ff8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1274 microversion: 2.1 time: 1.227121 Aug 03 12:11:40.070788 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 24/46] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:38 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1274 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:40.095346 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-003f18e4-1188-4a99-bda2-1eb6add21640 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:40.097354 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-003f18e4-1188-4a99-bda2-1eb6add21640 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:40.128183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-003f18e4-1188-4a99-bda2-1eb6add21640 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:40.130821 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-003f18e4-1188-4a99-bda2-1eb6add21640 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:40.134967 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-003f18e4-1188-4a99-bda2-1eb6add21640 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:40.137146 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-003f18e4-1188-4a99-bda2-1eb6add21640 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:40.755404 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-003f18e4-1188-4a99-bda2-1eb6add21640 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:40.804975 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-003f18e4-1188-4a99-bda2-1eb6add21640 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:40.816107 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-003f18e4-1188-4a99-bda2-1eb6add21640 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:40.835092 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-003f18e4-1188-4a99-bda2-1eb6add21640 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1340 microversion: 2.20 time: 0.749613 Aug 03 12:11:40.864630 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 25/47] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:40 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1340 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:40.903925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1fbd3c3f-f4c2-46d1-8664-1206eda51996 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:40.905048 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1fbd3c3f-f4c2-46d1-8664-1206eda51996 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:40.952013 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1fbd3c3f-f4c2-46d1-8664-1206eda51996 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:40.953087 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1fbd3c3f-f4c2-46d1-8664-1206eda51996 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:40.954566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1fbd3c3f-f4c2-46d1-8664-1206eda51996 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:40.955647 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1fbd3c3f-f4c2-46d1-8664-1206eda51996 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:41.816987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1fbd3c3f-f4c2-46d1-8664-1206eda51996 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:41.872352 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1fbd3c3f-f4c2-46d1-8664-1206eda51996 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1300 microversion: 2.1 time: 0.992534 Aug 03 12:11:41.889541 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 26/48] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:40 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1300 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:41.898896 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-efd50f14-2584-4dbb-8eb6-ce424cd69b0a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:41.924282 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-efd50f14-2584-4dbb-8eb6-ce424cd69b0a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 2.562706 Aug 03 12:11:41.925971 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9083f7ac-ec99-4a9e-ad04-c1e0ee483101 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:41.927044 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 23/49] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:39 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 2568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:41.928381 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9083f7ac-ec99-4a9e-ad04-c1e0ee483101 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:41.939141 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b2972db9-9cbe-4c11-a89a-c30c9e469f28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:41.939763 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b2972db9-9cbe-4c11-a89a-c30c9e469f28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:41.953586 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b2972db9-9cbe-4c11-a89a-c30c9e469f28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:41.954242 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b2972db9-9cbe-4c11-a89a-c30c9e469f28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:41.955529 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b2972db9-9cbe-4c11-a89a-c30c9e469f28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:41.955999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b2972db9-9cbe-4c11-a89a-c30c9e469f28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:41.959197 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9083f7ac-ec99-4a9e-ad04-c1e0ee483101 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:41.964460 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9083f7ac-ec99-4a9e-ad04-c1e0ee483101 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:41.988814 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9083f7ac-ec99-4a9e-ad04-c1e0ee483101 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:41.989904 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9083f7ac-ec99-4a9e-ad04-c1e0ee483101 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:42.140631 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b2972db9-9cbe-4c11-a89a-c30c9e469f28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:42.170110 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b2972db9-9cbe-4c11-a89a-c30c9e469f28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:42.178119 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b2972db9-9cbe-4c11-a89a-c30c9e469f28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:42.184954 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b2972db9-9cbe-4c11-a89a-c30c9e469f28 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1340 microversion: 2.20 time: 0.256106 Aug 03 12:11:42.186079 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 24/50] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:41 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1340 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:42.394232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9083f7ac-ec99-4a9e-ad04-c1e0ee483101 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:42.411925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9083f7ac-ec99-4a9e-ad04-c1e0ee483101 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1280 microversion: 2.1 time: 0.507534 Aug 03 12:11:42.412535 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 27/51] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:41 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1280 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:42.928812 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c4e19172-0b1e-47b4-ac78-f2cdde49b397 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:42.929744 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-c4e19172-0b1e-47b4-ac78-f2cdde49b397 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:42.940828 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=4 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:42.945831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=18 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:42.953446 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-761e842f-8441-46a0-aed9-240f127f3302 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:42.954290 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-761e842f-8441-46a0-aed9-240f127f3302 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:42.960532 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c4e19172-0b1e-47b4-ac78-f2cdde49b397 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:42.961930 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c4e19172-0b1e-47b4-ac78-f2cdde49b397 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:42.966961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c4e19172-0b1e-47b4-ac78-f2cdde49b397 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:42.970264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c4e19172-0b1e-47b4-ac78-f2cdde49b397 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:42.971065 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-761e842f-8441-46a0-aed9-240f127f3302 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:42.971513 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-761e842f-8441-46a0-aed9-240f127f3302 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:42.976752 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-761e842f-8441-46a0-aed9-240f127f3302 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:42.980952 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-761e842f-8441-46a0-aed9-240f127f3302 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:43.482184 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-c4e19172-0b1e-47b4-ac78-f2cdde49b397 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:43.503760 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c4e19172-0b1e-47b4-ac78-f2cdde49b397 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.583462 Aug 03 12:11:43.520759 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 25/52] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:42 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:43.848964 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-761e842f-8441-46a0-aed9-240f127f3302 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:43.858858 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-761e842f-8441-46a0-aed9-240f127f3302 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.914381 Aug 03 12:11:43.859975 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 28/53] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:42 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:43.866118 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c4259239-3c5b-4e9e-9766-4b74d26a6266 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:43.867511 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c4259239-3c5b-4e9e-9766-4b74d26a6266 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:43.875144 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c4259239-3c5b-4e9e-9766-4b74d26a6266 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:43.875592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c4259239-3c5b-4e9e-9766-4b74d26a6266 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:43.876367 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c4259239-3c5b-4e9e-9766-4b74d26a6266 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:43.876801 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c4259239-3c5b-4e9e-9766-4b74d26a6266 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:43.903750 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:43.995880 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-e42f9067-e1f4-45ea-80f6-9c6272abdc4b req-906afa4f-fb97-4134-8724-935451ffa529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dec6dd8-d607-422d-a774-65c4288a977a", "tag": "d73c6302-a297-4802-acac-097c970a6da3"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:44.015997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-e42f9067-e1f4-45ea-80f6-9c6272abdc4b req-906afa4f-fb97-4134-8724-935451ffa529 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:44.016806 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-e42f9067-e1f4-45ea-80f6-9c6272abdc4b req-906afa4f-fb97-4134-8724-935451ffa529 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:44.041381 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-e42f9067-e1f4-45ea-80f6-9c6272abdc4b req-906afa4f-fb97-4134-8724-935451ffa529 service nova] Creating event network-changed:d73c6302-a297-4802-acac-097c970a6da3 for instance 2dec6dd8-d607-422d-a774-65c4288a977a on hv-cinder-83602 Aug 03 12:11:44.042488 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-e42f9067-e1f4-45ea-80f6-9c6272abdc4b req-906afa4f-fb97-4134-8724-935451ffa529 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117911) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 12:11:44.044022 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fe60baba-1820-4039-a89a-668b26fd3d5d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:44.044701 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fe60baba-1820-4039-a89a-668b26fd3d5d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:44.045742 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fe60baba-1820-4039-a89a-668b26fd3d5d None None] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:44.046382 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fe60baba-1820-4039-a89a-668b26fd3d5d None None] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:44.055571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c4259239-3c5b-4e9e-9766-4b74d26a6266 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:44.057204 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.compute.rpcapi [None req-fe60baba-1820-4039-a89a-668b26fd3d5d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 12:11:44.058246 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fe60baba-1820-4039-a89a-668b26fd3d5d None None] Releasing lock "compute-rpcapi-router" {{(pid=117911) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 12:11:44.065663 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c4259239-3c5b-4e9e-9766-4b74d26a6266 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:44.069405 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c4259239-3c5b-4e9e-9766-4b74d26a6266 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:44.072815 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c4259239-3c5b-4e9e-9766-4b74d26a6266 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.211607 Aug 03 12:11:44.076765 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 29/54] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:43 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:44.081151 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3cd52532-f33b-46d0-933d-25291e17418a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:44.082114 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3cd52532-f33b-46d0-933d-25291e17418a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:44.090223 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3cd52532-f33b-46d0-933d-25291e17418a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:44.090881 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3cd52532-f33b-46d0-933d-25291e17418a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:44.091859 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3cd52532-f33b-46d0-933d-25291e17418a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:44.092408 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3cd52532-f33b-46d0-933d-25291e17418a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:44.094386 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-fe60baba-1820-4039-a89a-668b26fd3d5d None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.570096 Aug 03 12:11:44.095446 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 26/55] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:11:44.178230 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3cd52532-f33b-46d0-933d-25291e17418a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:44.186536 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3cd52532-f33b-46d0-933d-25291e17418a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1280 microversion: 2.1 time: 0.109111 Aug 03 12:11:44.195175 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 30/56] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:44 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1280 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:44.403363 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-b37f1a23-8c32-4340-a59a-dd9c896d2ad9 req-8698f115-467c-4793-9ef8-b2532845e782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edbf4859-738e-4993-8a7a-006a27c69279", "tag": "0c84946e-8f0e-48e4-a558-b8ad74fc5016"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:44.419748 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-b37f1a23-8c32-4340-a59a-dd9c896d2ad9 req-8698f115-467c-4793-9ef8-b2532845e782 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:44.420570 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-b37f1a23-8c32-4340-a59a-dd9c896d2ad9 req-8698f115-467c-4793-9ef8-b2532845e782 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:44.440113 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-b37f1a23-8c32-4340-a59a-dd9c896d2ad9 req-8698f115-467c-4793-9ef8-b2532845e782 service nova] Creating event network-changed:0c84946e-8f0e-48e4-a558-b8ad74fc5016 for instance edbf4859-738e-4993-8a7a-006a27c69279 on hv-cinder-83602 Aug 03 12:11:44.446006 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-b37f1a23-8c32-4340-a59a-dd9c896d2ad9 req-8698f115-467c-4793-9ef8-b2532845e782 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275109 Aug 03 12:11:44.447369 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 27/57] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:11:44.541260 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9294aea3-1fe3-4e7b-888f-b854e36c1cdd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:44.542434 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9294aea3-1fe3-4e7b-888f-b854e36c1cdd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:44.550265 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9294aea3-1fe3-4e7b-888f-b854e36c1cdd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:44.551028 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9294aea3-1fe3-4e7b-888f-b854e36c1cdd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:44.551962 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9294aea3-1fe3-4e7b-888f-b854e36c1cdd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:44.552542 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9294aea3-1fe3-4e7b-888f-b854e36c1cdd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:44.623419 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=22 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:44.831505 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9294aea3-1fe3-4e7b-888f-b854e36c1cdd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:44.842108 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9294aea3-1fe3-4e7b-888f-b854e36c1cdd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.304639 Aug 03 12:11:44.843462 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 31/58] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:44 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:44.886161 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d5dd811f-dd18-455f-af3a-1d7132ce3186 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:44.896214 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d5dd811f-dd18-455f-af3a-1d7132ce3186 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:44.918788 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d5dd811f-dd18-455f-af3a-1d7132ce3186 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:44.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d5dd811f-dd18-455f-af3a-1d7132ce3186 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:44.920626 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d5dd811f-dd18-455f-af3a-1d7132ce3186 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:44.921103 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d5dd811f-dd18-455f-af3a-1d7132ce3186 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:45.097208 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b7bc4908-3414-4f57-afc2-5c59d6bdcaf4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:45.098374 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b7bc4908-3414-4f57-afc2-5c59d6bdcaf4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:45.117067 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7bc4908-3414-4f57-afc2-5c59d6bdcaf4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:45.117801 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7bc4908-3414-4f57-afc2-5c59d6bdcaf4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:45.118886 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7bc4908-3414-4f57-afc2-5c59d6bdcaf4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:45.119557 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7bc4908-3414-4f57-afc2-5c59d6bdcaf4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:45.306427 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d5dd811f-dd18-455f-af3a-1d7132ce3186 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:45.334602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d5dd811f-dd18-455f-af3a-1d7132ce3186 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.446583 Aug 03 12:11:45.335883 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 28/59] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:44 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:45.357234 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-953a7482-1fd6-4a59-8b5e-397405ca7a84 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:45.358533 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-953a7482-1fd6-4a59-8b5e-397405ca7a84 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:45.382266 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-953a7482-1fd6-4a59-8b5e-397405ca7a84 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:45.383146 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-953a7482-1fd6-4a59-8b5e-397405ca7a84 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:45.384316 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-953a7482-1fd6-4a59-8b5e-397405ca7a84 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:45.384929 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-953a7482-1fd6-4a59-8b5e-397405ca7a84 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:46.163411 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-953a7482-1fd6-4a59-8b5e-397405ca7a84 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:46.205314 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-953a7482-1fd6-4a59-8b5e-397405ca7a84 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1280 microversion: 2.1 time: 0.867738 Aug 03 12:11:46.215438 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 29/60] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:45 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1280 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:46.264628 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2510a513-34c6-458d-ba33-26643ec77fd9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:46.265915 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2510a513-34c6-458d-ba33-26643ec77fd9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:46.316139 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2510a513-34c6-458d-ba33-26643ec77fd9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:46.319638 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2510a513-34c6-458d-ba33-26643ec77fd9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:46.324294 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2510a513-34c6-458d-ba33-26643ec77fd9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:46.328094 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2510a513-34c6-458d-ba33-26643ec77fd9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:46.591145 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b7bc4908-3414-4f57-afc2-5c59d6bdcaf4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:46.611247 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b7bc4908-3414-4f57-afc2-5c59d6bdcaf4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:46.617617 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b7bc4908-3414-4f57-afc2-5c59d6bdcaf4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:46.619431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b7bc4908-3414-4f57-afc2-5c59d6bdcaf4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 1.526073 Aug 03 12:11:46.650028 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 32/61] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:45 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:46.672518 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4322b834-77d6-414c-8111-479d66f882bb tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:46.674428 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4322b834-77d6-414c-8111-479d66f882bb tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:46.714160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4322b834-77d6-414c-8111-479d66f882bb tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:46.715434 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4322b834-77d6-414c-8111-479d66f882bb tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:46.720986 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4322b834-77d6-414c-8111-479d66f882bb tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:46.723967 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4322b834-77d6-414c-8111-479d66f882bb tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:48.090204 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4322b834-77d6-414c-8111-479d66f882bb tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:48.102055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4322b834-77d6-414c-8111-479d66f882bb tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 1.446308 Aug 03 12:11:48.104338 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 33/62] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:46 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:48.115206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3664167c-9d71-4fc7-a662-0d9547a101a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:48.117678 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3664167c-9d71-4fc7-a662-0d9547a101a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:48.137449 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3664167c-9d71-4fc7-a662-0d9547a101a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:48.138157 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3664167c-9d71-4fc7-a662-0d9547a101a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:48.148438 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3664167c-9d71-4fc7-a662-0d9547a101a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:48.148966 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3664167c-9d71-4fc7-a662-0d9547a101a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:48.175823 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2510a513-34c6-458d-ba33-26643ec77fd9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:48.183190 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=100 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:48.207290 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2510a513-34c6-458d-ba33-26643ec77fd9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 1.990605 Aug 03 12:11:48.245908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 30/63] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:46 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:48.263734 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cc729d29-f048-45e5-bb83-513e11ee7d11 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:48.265019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-cc729d29-f048-45e5-bb83-513e11ee7d11 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:48.277657 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cc729d29-f048-45e5-bb83-513e11ee7d11 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:48.278114 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cc729d29-f048-45e5-bb83-513e11ee7d11 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:48.279032 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cc729d29-f048-45e5-bb83-513e11ee7d11 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:48.279484 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cc729d29-f048-45e5-bb83-513e11ee7d11 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:48.647782 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3664167c-9d71-4fc7-a662-0d9547a101a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:48.661498 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3664167c-9d71-4fc7-a662-0d9547a101a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1280 microversion: 2.1 time: 0.555284 Aug 03 12:11:48.673993 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 34/64] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:48 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1280 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:49.095297 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cc729d29-f048-45e5-bb83-513e11ee7d11 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:49.112964 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cc729d29-f048-45e5-bb83-513e11ee7d11 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:49.117431 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cc729d29-f048-45e5-bb83-513e11ee7d11 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:49.118682 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-cc729d29-f048-45e5-bb83-513e11ee7d11 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.875524 Aug 03 12:11:49.119808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 31/65] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:48 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:49.143641 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a67d72b8-3537-4ecd-85bb-3af40a02db0f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:49.144276 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a67d72b8-3537-4ecd-85bb-3af40a02db0f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:49.163081 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a67d72b8-3537-4ecd-85bb-3af40a02db0f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:49.163850 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a67d72b8-3537-4ecd-85bb-3af40a02db0f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:49.164917 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a67d72b8-3537-4ecd-85bb-3af40a02db0f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:49.165615 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a67d72b8-3537-4ecd-85bb-3af40a02db0f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:49.253668 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-47f71815-b76b-4dec-b382-065ad4736407 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:49.254294 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-47f71815-b76b-4dec-b382-065ad4736407 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:49.264209 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-47f71815-b76b-4dec-b382-065ad4736407 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:49.264831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-47f71815-b76b-4dec-b382-065ad4736407 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:49.266031 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-47f71815-b76b-4dec-b382-065ad4736407 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:49.267886 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-47f71815-b76b-4dec-b382-065ad4736407 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:49.590945 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a67d72b8-3537-4ecd-85bb-3af40a02db0f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:49.631378 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a67d72b8-3537-4ecd-85bb-3af40a02db0f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.509354 Aug 03 12:11:49.653010 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 35/66] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:49 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:49.665188 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-167da5a2-7bcc-42ba-bd3a-2cd00a4960d0 req-d78c53e8-3bd7-42a3-bc38-e61be1110816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4afb38cd-ec9c-4509-b7c8-91b170684ec5", "tag": "8f2969cf-b117-4fef-a2f6-5587992eefda"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:49.719410 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-167da5a2-7bcc-42ba-bd3a-2cd00a4960d0 req-d78c53e8-3bd7-42a3-bc38-e61be1110816 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:49.719988 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-167da5a2-7bcc-42ba-bd3a-2cd00a4960d0 req-d78c53e8-3bd7-42a3-bc38-e61be1110816 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:49.756349 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-167da5a2-7bcc-42ba-bd3a-2cd00a4960d0 req-d78c53e8-3bd7-42a3-bc38-e61be1110816 service nova] Creating event network-changed:8f2969cf-b117-4fef-a2f6-5587992eefda for instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 on hv-cinder-83602 Aug 03 12:11:49.757278 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-167da5a2-7bcc-42ba-bd3a-2cd00a4960d0 req-d78c53e8-3bd7-42a3-bc38-e61be1110816 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117910) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 12:11:49.758908 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03ee50cc-d4b8-4aed-9461-7e4cdc4801ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:49.759665 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03ee50cc-d4b8-4aed-9461-7e4cdc4801ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:49.760997 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03ee50cc-d4b8-4aed-9461-7e4cdc4801ba None None] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:49.761662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03ee50cc-d4b8-4aed-9461-7e4cdc4801ba None None] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:49.782086 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.compute.rpcapi [None req-03ee50cc-d4b8-4aed-9461-7e4cdc4801ba None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 12:11:49.783939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03ee50cc-d4b8-4aed-9461-7e4cdc4801ba None None] Releasing lock "compute-rpcapi-router" {{(pid=117910) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 12:11:49.824045 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-03ee50cc-d4b8-4aed-9461-7e4cdc4801ba None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167988 Aug 03 12:11:49.824696 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 36/67] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:11:49.830662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8f06eeb7-f0d1-4eaa-b233-352d332eb1a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:49.831419 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8f06eeb7-f0d1-4eaa-b233-352d332eb1a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:49.854780 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f06eeb7-f0d1-4eaa-b233-352d332eb1a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:49.855467 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f06eeb7-f0d1-4eaa-b233-352d332eb1a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:49.857927 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f06eeb7-f0d1-4eaa-b233-352d332eb1a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:49.858433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f06eeb7-f0d1-4eaa-b233-352d332eb1a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:50.365719 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-47f71815-b76b-4dec-b382-065ad4736407 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:50.390066 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-47f71815-b76b-4dec-b382-065ad4736407 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 1.131935 Aug 03 12:11:50.391146 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 32/68] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:49 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:50.397396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-9fcc0df8-92e4-4961-b6f6-81144a1000cc req-82aa70cc-5650-4086-bc80-547865d9392e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fedea0ca-7f85-49dc-8459-160418843f05", "tag": "1d3fd848-19fd-4089-a319-b9a584a9c430"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:50.416273 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-9fcc0df8-92e4-4961-b6f6-81144a1000cc req-82aa70cc-5650-4086-bc80-547865d9392e service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:50.416768 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-9fcc0df8-92e4-4961-b6f6-81144a1000cc req-82aa70cc-5650-4086-bc80-547865d9392e service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:50.429570 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-9fcc0df8-92e4-4961-b6f6-81144a1000cc req-82aa70cc-5650-4086-bc80-547865d9392e service nova] Creating event network-changed:1d3fd848-19fd-4089-a319-b9a584a9c430 for instance fedea0ca-7f85-49dc-8459-160418843f05 on hv-cinder-83602 Aug 03 12:11:50.436108 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-9fcc0df8-92e4-4961-b6f6-81144a1000cc req-82aa70cc-5650-4086-bc80-547865d9392e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043551 Aug 03 12:11:50.439983 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 33/69] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:11:50.445858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-46601383-4978-40ff-8442-58957a725d08 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:50.446620 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-46601383-4978-40ff-8442-58957a725d08 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:50.454243 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46601383-4978-40ff-8442-58957a725d08 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:50.454771 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46601383-4978-40ff-8442-58957a725d08 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:50.455627 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46601383-4978-40ff-8442-58957a725d08 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:50.456082 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46601383-4978-40ff-8442-58957a725d08 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:50.507789 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8f06eeb7-f0d1-4eaa-b233-352d332eb1a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:50.519205 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8f06eeb7-f0d1-4eaa-b233-352d332eb1a3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.693151 Aug 03 12:11:50.519940 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 37/70] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:49 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:50.656756 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4bb84248-3a6e-4846-9d8e-5a33dfd03637 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:50.657379 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4bb84248-3a6e-4846-9d8e-5a33dfd03637 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:50.662613 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-46601383-4978-40ff-8442-58957a725d08 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:50.665412 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bb84248-3a6e-4846-9d8e-5a33dfd03637 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:50.666035 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bb84248-3a6e-4846-9d8e-5a33dfd03637 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:50.667821 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bb84248-3a6e-4846-9d8e-5a33dfd03637 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:50.668429 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bb84248-3a6e-4846-9d8e-5a33dfd03637 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:50.673983 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-46601383-4978-40ff-8442-58957a725d08 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:50.676109 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-46601383-4978-40ff-8442-58957a725d08 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:50.677761 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-46601383-4978-40ff-8442-58957a725d08 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.235985 Aug 03 12:11:50.678756 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 34/71] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:50 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:50.927730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4bb84248-3a6e-4846-9d8e-5a33dfd03637 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:50.936693 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4bb84248-3a6e-4846-9d8e-5a33dfd03637 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.284049 Aug 03 12:11:50.940732 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 38/72] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:50 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:51.416218 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-dbf89454-5ef5-4c07-a190-5569c0314aca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:51.418424 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-dbf89454-5ef5-4c07-a190-5569c0314aca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:51.441822 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dbf89454-5ef5-4c07-a190-5569c0314aca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:51.452308 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dbf89454-5ef5-4c07-a190-5569c0314aca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:51.456835 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dbf89454-5ef5-4c07-a190-5569c0314aca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:51.457934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dbf89454-5ef5-4c07-a190-5569c0314aca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:51.549281 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e47a7554-e392-4570-8e75-caa54e3944df tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:51.550221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e47a7554-e392-4570-8e75-caa54e3944df tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:51.560810 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e47a7554-e392-4570-8e75-caa54e3944df tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:51.561266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e47a7554-e392-4570-8e75-caa54e3944df tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:51.562623 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e47a7554-e392-4570-8e75-caa54e3944df tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:51.563176 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e47a7554-e392-4570-8e75-caa54e3944df tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:51.834530 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dbf89454-5ef5-4c07-a190-5569c0314aca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:51.860841 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-dbf89454-5ef5-4c07-a190-5569c0314aca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.451280 Aug 03 12:11:51.871379 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 35/73] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:51 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:51.889421 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2e04b3ea-c93b-4542-8e16-e902dba6910b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:51.894302 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2e04b3ea-c93b-4542-8e16-e902dba6910b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:51.917868 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e47a7554-e392-4570-8e75-caa54e3944df tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:51.920813 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2e04b3ea-c93b-4542-8e16-e902dba6910b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:51.921692 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2e04b3ea-c93b-4542-8e16-e902dba6910b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:51.923259 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2e04b3ea-c93b-4542-8e16-e902dba6910b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:51.923929 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2e04b3ea-c93b-4542-8e16-e902dba6910b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:51.929775 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e47a7554-e392-4570-8e75-caa54e3944df tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.385798 Aug 03 12:11:51.930767 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 39/74] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:51 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:51.971462 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-76dc6f30-ac32-47fd-893b-8e3948fbab88 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:51.972694 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-76dc6f30-ac32-47fd-893b-8e3948fbab88 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:51.999510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-76dc6f30-ac32-47fd-893b-8e3948fbab88 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:52.001079 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-76dc6f30-ac32-47fd-893b-8e3948fbab88 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:52.002793 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-76dc6f30-ac32-47fd-893b-8e3948fbab88 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:52.003791 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-76dc6f30-ac32-47fd-893b-8e3948fbab88 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:52.180557 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2e04b3ea-c93b-4542-8e16-e902dba6910b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:52.203553 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2e04b3ea-c93b-4542-8e16-e902dba6910b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:52.205419 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2e04b3ea-c93b-4542-8e16-e902dba6910b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:52.211519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2e04b3ea-c93b-4542-8e16-e902dba6910b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.340587 Aug 03 12:11:52.228602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 36/75] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:51 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:52.316001 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-76dc6f30-ac32-47fd-893b-8e3948fbab88 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:52.324622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-76dc6f30-ac32-47fd-893b-8e3948fbab88 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.359377 Aug 03 12:11:52.343774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 40/76] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:51 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:52.885894 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-bb3fd997-7494-494b-822f-bd05746ad3a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:52.886879 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-bb3fd997-7494-494b-822f-bd05746ad3a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:52.899590 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bb3fd997-7494-494b-822f-bd05746ad3a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:52.900084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bb3fd997-7494-494b-822f-bd05746ad3a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:52.900988 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bb3fd997-7494-494b-822f-bd05746ad3a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:52.901452 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bb3fd997-7494-494b-822f-bd05746ad3a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:53.001688 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3e0cadb2-8758-4221-956f-f60f9e08a535 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:53.002680 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3e0cadb2-8758-4221-956f-f60f9e08a535 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:53.013663 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3e0cadb2-8758-4221-956f-f60f9e08a535 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:53.014113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3e0cadb2-8758-4221-956f-f60f9e08a535 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:53.023659 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3e0cadb2-8758-4221-956f-f60f9e08a535 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:53.024119 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3e0cadb2-8758-4221-956f-f60f9e08a535 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:53.273434 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-bb3fd997-7494-494b-822f-bd05746ad3a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:53.292369 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-bb3fd997-7494-494b-822f-bd05746ad3a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.408750 Aug 03 12:11:53.297134 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 37/77] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:52 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:53.306948 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-222eb301-81bc-46f7-a4e5-f0cfe2ff7797 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:53.314088 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-222eb301-81bc-46f7-a4e5-f0cfe2ff7797 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:53.338276 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-222eb301-81bc-46f7-a4e5-f0cfe2ff7797 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:53.340704 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-222eb301-81bc-46f7-a4e5-f0cfe2ff7797 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:53.344532 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-222eb301-81bc-46f7-a4e5-f0cfe2ff7797 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:53.346106 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-222eb301-81bc-46f7-a4e5-f0cfe2ff7797 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:53.421121 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3e0cadb2-8758-4221-956f-f60f9e08a535 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:53.434950 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3e0cadb2-8758-4221-956f-f60f9e08a535 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.440292 Aug 03 12:11:53.437405 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 41/78] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:52 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:53.442838 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e516745a-20fc-46d8-9ab7-fa37e75cd220 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:53.444227 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e516745a-20fc-46d8-9ab7-fa37e75cd220 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:53.457785 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e516745a-20fc-46d8-9ab7-fa37e75cd220 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:53.458698 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e516745a-20fc-46d8-9ab7-fa37e75cd220 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:53.459807 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e516745a-20fc-46d8-9ab7-fa37e75cd220 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:53.460430 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e516745a-20fc-46d8-9ab7-fa37e75cd220 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:53.692130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e516745a-20fc-46d8-9ab7-fa37e75cd220 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:53.742091 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e516745a-20fc-46d8-9ab7-fa37e75cd220 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.303368 Aug 03 12:11:53.749561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 42/79] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:53 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:54.055884 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:54.342412 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-222eb301-81bc-46f7-a4e5-f0cfe2ff7797 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:54.345134 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-69a7ad62-e74b-4223-a6aa-20205b2e21d9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:54.346869 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-69a7ad62-e74b-4223-a6aa-20205b2e21d9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:54.352059 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-222eb301-81bc-46f7-a4e5-f0cfe2ff7797 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:54.358692 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-222eb301-81bc-46f7-a4e5-f0cfe2ff7797 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:54.360282 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-222eb301-81bc-46f7-a4e5-f0cfe2ff7797 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 1.059448 Aug 03 12:11:54.362005 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-69a7ad62-e74b-4223-a6aa-20205b2e21d9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:54.363338 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-69a7ad62-e74b-4223-a6aa-20205b2e21d9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:54.363480 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 38/80] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:53 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:54.366566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-69a7ad62-e74b-4223-a6aa-20205b2e21d9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:54.367474 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-69a7ad62-e74b-4223-a6aa-20205b2e21d9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:54.461210 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d609cf40-0f01-4693-8ac5-9b079ebb9ffb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:54.461980 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d609cf40-0f01-4693-8ac5-9b079ebb9ffb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:54.481017 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d609cf40-0f01-4693-8ac5-9b079ebb9ffb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:54.481464 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d609cf40-0f01-4693-8ac5-9b079ebb9ffb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:54.482478 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d609cf40-0f01-4693-8ac5-9b079ebb9ffb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:54.483236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d609cf40-0f01-4693-8ac5-9b079ebb9ffb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:54.936355 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-69a7ad62-e74b-4223-a6aa-20205b2e21d9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:54.945282 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-69a7ad62-e74b-4223-a6aa-20205b2e21d9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.612980 Aug 03 12:11:54.959893 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 43/81] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:54 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:54.965996 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c49978a3-7def-4666-8cb2-e6c2b2e86161 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:54.967005 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c49978a3-7def-4666-8cb2-e6c2b2e86161 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:54.974485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c49978a3-7def-4666-8cb2-e6c2b2e86161 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:54.975171 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c49978a3-7def-4666-8cb2-e6c2b2e86161 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:54.976236 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c49978a3-7def-4666-8cb2-e6c2b2e86161 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:54.976873 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c49978a3-7def-4666-8cb2-e6c2b2e86161 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:55.113198 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d609cf40-0f01-4693-8ac5-9b079ebb9ffb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:55.122762 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d609cf40-0f01-4693-8ac5-9b079ebb9ffb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.664863 Aug 03 12:11:55.123714 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 39/82] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:54 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:55.236650 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c49978a3-7def-4666-8cb2-e6c2b2e86161 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:55.250580 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c49978a3-7def-4666-8cb2-e6c2b2e86161 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.288684 Aug 03 12:11:55.251672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 44/83] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:54 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:55.387675 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-71356563-ce73-45aa-9637-4aa9f3fa9b93 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:55.388328 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-71356563-ce73-45aa-9637-4aa9f3fa9b93 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:55.398141 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71356563-ce73-45aa-9637-4aa9f3fa9b93 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:55.399017 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71356563-ce73-45aa-9637-4aa9f3fa9b93 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:55.400522 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71356563-ce73-45aa-9637-4aa9f3fa9b93 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:55.401887 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71356563-ce73-45aa-9637-4aa9f3fa9b93 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:55.601221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-cc44d81f-2b27-4088-8d0d-82ba273bb022 req-3c847164-c13f-4522-9973-208b807be0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abf9a529-07b3-4797-bc51-75b210ae9933", "tag": "d86d0e52-6fc7-4559-85a8-02b7160a4f64"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:11:55.621413 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-cc44d81f-2b27-4088-8d0d-82ba273bb022 req-3c847164-c13f-4522-9973-208b807be0b7 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:55.622368 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-cc44d81f-2b27-4088-8d0d-82ba273bb022 req-3c847164-c13f-4522-9973-208b807be0b7 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:55.646719 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-cc44d81f-2b27-4088-8d0d-82ba273bb022 req-3c847164-c13f-4522-9973-208b807be0b7 service nova] Creating event network-changed:d86d0e52-6fc7-4559-85a8-02b7160a4f64 for instance abf9a529-07b3-4797-bc51-75b210ae9933 on hv-cinder-83602 Aug 03 12:11:55.655958 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-cc44d81f-2b27-4088-8d0d-82ba273bb022 req-3c847164-c13f-4522-9973-208b807be0b7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061936 Aug 03 12:11:55.661142 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 45/84] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:11:55.697287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-71356563-ce73-45aa-9637-4aa9f3fa9b93 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:55.708916 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-71356563-ce73-45aa-9637-4aa9f3fa9b93 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:55.711303 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-71356563-ce73-45aa-9637-4aa9f3fa9b93 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:55.712384 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-71356563-ce73-45aa-9637-4aa9f3fa9b93 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.329916 Aug 03 12:11:55.718549 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 40/85] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:55 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:55.968450 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d118d7de-db25-49dc-b9cc-ed465a27fe19 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:55.969466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d118d7de-db25-49dc-b9cc-ed465a27fe19 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:55.977374 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d118d7de-db25-49dc-b9cc-ed465a27fe19 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:55.977835 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d118d7de-db25-49dc-b9cc-ed465a27fe19 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:55.978693 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d118d7de-db25-49dc-b9cc-ed465a27fe19 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:55.979713 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d118d7de-db25-49dc-b9cc-ed465a27fe19 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:56.144786 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-564dae88-4883-408e-aa21-f0f09cece602 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:56.146430 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-564dae88-4883-408e-aa21-f0f09cece602 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:56.154364 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-564dae88-4883-408e-aa21-f0f09cece602 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:56.154881 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-564dae88-4883-408e-aa21-f0f09cece602 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:56.155686 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-564dae88-4883-408e-aa21-f0f09cece602 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:56.156145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-564dae88-4883-408e-aa21-f0f09cece602 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:56.156790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d118d7de-db25-49dc-b9cc-ed465a27fe19 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:56.175072 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d118d7de-db25-49dc-b9cc-ed465a27fe19 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.210477 Aug 03 12:11:56.176309 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 46/86] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:55 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:56.274615 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-84ed8394-d755-4c28-b0a3-042a077d06d3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:56.275657 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-84ed8394-d755-4c28-b0a3-042a077d06d3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:56.283281 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-84ed8394-d755-4c28-b0a3-042a077d06d3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:56.284000 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-84ed8394-d755-4c28-b0a3-042a077d06d3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:56.285276 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-84ed8394-d755-4c28-b0a3-042a077d06d3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:56.285877 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-84ed8394-d755-4c28-b0a3-042a077d06d3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:56.299791 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:56.319074 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-564dae88-4883-408e-aa21-f0f09cece602 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:56.329868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-564dae88-4883-408e-aa21-f0f09cece602 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.189204 Aug 03 12:11:56.330883 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 41/87] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:56 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:56.490684 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-84ed8394-d755-4c28-b0a3-042a077d06d3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:56.498553 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-84ed8394-d755-4c28-b0a3-042a077d06d3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.228479 Aug 03 12:11:56.499163 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 47/88] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:56 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:56.750959 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3cf1308a-ba76-44b5-bebc-82130bd89f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:56.752177 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-3cf1308a-ba76-44b5-bebc-82130bd89f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:56.763949 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3cf1308a-ba76-44b5-bebc-82130bd89f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:56.765127 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3cf1308a-ba76-44b5-bebc-82130bd89f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:56.766295 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3cf1308a-ba76-44b5-bebc-82130bd89f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:56.767151 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3cf1308a-ba76-44b5-bebc-82130bd89f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:56.948498 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-3cf1308a-ba76-44b5-bebc-82130bd89f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:56.959296 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-3cf1308a-ba76-44b5-bebc-82130bd89f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:56.961649 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-3cf1308a-ba76-44b5-bebc-82130bd89f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:56.963329 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-3cf1308a-ba76-44b5-bebc-82130bd89f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.219608 Aug 03 12:11:56.964411 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 42/89] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:56 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:57.199120 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-dba57bc7-ceb6-41f2-98ea-5f4f20408d91 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:57.199831 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-dba57bc7-ceb6-41f2-98ea-5f4f20408d91 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:57.206276 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dba57bc7-ceb6-41f2-98ea-5f4f20408d91 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:57.206759 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dba57bc7-ceb6-41f2-98ea-5f4f20408d91 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:57.207587 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dba57bc7-ceb6-41f2-98ea-5f4f20408d91 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:57.208029 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dba57bc7-ceb6-41f2-98ea-5f4f20408d91 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:57.359132 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-dba57bc7-ceb6-41f2-98ea-5f4f20408d91 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:57.363309 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a941335f-b4f5-4659-bfee-7b182474ebde tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:57.363931 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a941335f-b4f5-4659-bfee-7b182474ebde tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:57.367208 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-dba57bc7-ceb6-41f2-98ea-5f4f20408d91 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.172866 Aug 03 12:11:57.367836 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 48/90] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:57 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:57.370538 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a941335f-b4f5-4659-bfee-7b182474ebde tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:57.370999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a941335f-b4f5-4659-bfee-7b182474ebde tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:57.371793 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a941335f-b4f5-4659-bfee-7b182474ebde tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:57.372235 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a941335f-b4f5-4659-bfee-7b182474ebde tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:57.520066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-96f16188-3532-407f-82b3-1ed2c7d094fc tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:57.521591 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-96f16188-3532-407f-82b3-1ed2c7d094fc tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:57.530547 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-96f16188-3532-407f-82b3-1ed2c7d094fc tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:57.531081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a941335f-b4f5-4659-bfee-7b182474ebde tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:57.531269 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-96f16188-3532-407f-82b3-1ed2c7d094fc tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:57.532457 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-96f16188-3532-407f-82b3-1ed2c7d094fc tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:57.532971 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-96f16188-3532-407f-82b3-1ed2c7d094fc tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:57.538908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a941335f-b4f5-4659-bfee-7b182474ebde tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.179580 Aug 03 12:11:57.539507 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 43/91] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:57 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:57.705957 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-96f16188-3532-407f-82b3-1ed2c7d094fc tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:57.714586 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-96f16188-3532-407f-82b3-1ed2c7d094fc tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.198635 Aug 03 12:11:57.715595 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 49/92] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:57 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:57.986737 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-eb82bc9d-b870-4a97-9d83-e1acd576a890 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:57.987272 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-eb82bc9d-b870-4a97-9d83-e1acd576a890 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:57.993345 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-eb82bc9d-b870-4a97-9d83-e1acd576a890 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:57.993801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-eb82bc9d-b870-4a97-9d83-e1acd576a890 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:57.995135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-eb82bc9d-b870-4a97-9d83-e1acd576a890 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:57.995855 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-eb82bc9d-b870-4a97-9d83-e1acd576a890 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:58.169785 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-eb82bc9d-b870-4a97-9d83-e1acd576a890 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:58.180681 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-eb82bc9d-b870-4a97-9d83-e1acd576a890 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:58.182884 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-eb82bc9d-b870-4a97-9d83-e1acd576a890 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:58.184025 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-eb82bc9d-b870-4a97-9d83-e1acd576a890 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.201627 Aug 03 12:11:58.184927 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 44/93] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:57 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:58.388720 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9b4eef5b-64a6-4f05-b0f7-aa211e4b8284 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:58.389542 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9b4eef5b-64a6-4f05-b0f7-aa211e4b8284 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:58.395899 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9b4eef5b-64a6-4f05-b0f7-aa211e4b8284 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:58.396333 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9b4eef5b-64a6-4f05-b0f7-aa211e4b8284 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:58.397108 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9b4eef5b-64a6-4f05-b0f7-aa211e4b8284 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:58.397528 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9b4eef5b-64a6-4f05-b0f7-aa211e4b8284 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:58.543396 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9b4eef5b-64a6-4f05-b0f7-aa211e4b8284 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:58.551676 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9b4eef5b-64a6-4f05-b0f7-aa211e4b8284 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.166842 Aug 03 12:11:58.552276 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 50/94] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:58 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:58.561748 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a8ec7273-1290-4e57-8119-0bcdcb6fa48d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:58.562582 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a8ec7273-1290-4e57-8119-0bcdcb6fa48d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:58.569768 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a8ec7273-1290-4e57-8119-0bcdcb6fa48d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:58.570281 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a8ec7273-1290-4e57-8119-0bcdcb6fa48d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:58.571268 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a8ec7273-1290-4e57-8119-0bcdcb6fa48d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:58.571792 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a8ec7273-1290-4e57-8119-0bcdcb6fa48d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:58.717425 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a8ec7273-1290-4e57-8119-0bcdcb6fa48d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:58.725498 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a8ec7273-1290-4e57-8119-0bcdcb6fa48d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.167957 Aug 03 12:11:58.726094 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 45/95] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:58 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:58.740885 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d146ec64-b1b7-4044-8ecb-bcd0e99dd5e3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:58.742017 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d146ec64-b1b7-4044-8ecb-bcd0e99dd5e3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:58.753331 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d146ec64-b1b7-4044-8ecb-bcd0e99dd5e3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:58.754116 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d146ec64-b1b7-4044-8ecb-bcd0e99dd5e3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:58.755509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d146ec64-b1b7-4044-8ecb-bcd0e99dd5e3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:58.755974 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d146ec64-b1b7-4044-8ecb-bcd0e99dd5e3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:58.924867 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d146ec64-b1b7-4044-8ecb-bcd0e99dd5e3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:58.932814 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d146ec64-b1b7-4044-8ecb-bcd0e99dd5e3 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.200167 Aug 03 12:11:58.933410 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 51/96] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:58 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:59.207460 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6c1ec211-4627-4633-a46b-10fae2fd443e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:59.208077 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-6c1ec211-4627-4633-a46b-10fae2fd443e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:59.214635 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6c1ec211-4627-4633-a46b-10fae2fd443e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:59.215073 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6c1ec211-4627-4633-a46b-10fae2fd443e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:59.215852 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6c1ec211-4627-4633-a46b-10fae2fd443e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:59.216288 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6c1ec211-4627-4633-a46b-10fae2fd443e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:59.407379 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-6c1ec211-4627-4633-a46b-10fae2fd443e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:59.416150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-6c1ec211-4627-4633-a46b-10fae2fd443e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:59.418309 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-6c1ec211-4627-4633-a46b-10fae2fd443e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:59.419592 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6c1ec211-4627-4633-a46b-10fae2fd443e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.216480 Aug 03 12:11:59.420210 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 46/97] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:11:59 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:11:59.574297 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9ece1c99-6ff0-46ec-89c2-cbf10b768147 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:59.574995 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9ece1c99-6ff0-46ec-89c2-cbf10b768147 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:59.581572 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9ece1c99-6ff0-46ec-89c2-cbf10b768147 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:59.582040 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9ece1c99-6ff0-46ec-89c2-cbf10b768147 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:59.582859 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9ece1c99-6ff0-46ec-89c2-cbf10b768147 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:59.583292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9ece1c99-6ff0-46ec-89c2-cbf10b768147 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:59.739190 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9ece1c99-6ff0-46ec-89c2-cbf10b768147 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:59.748162 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9ece1c99-6ff0-46ec-89c2-cbf10b768147 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.178417 Aug 03 12:11:59.748475 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7f60888c-dbda-4812-a5ab-7085c7537f46 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:59.755001 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 52/98] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:59 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:11:59.755139 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7f60888c-dbda-4812-a5ab-7085c7537f46 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:59.760936 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7f60888c-dbda-4812-a5ab-7085c7537f46 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:59.761714 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7f60888c-dbda-4812-a5ab-7085c7537f46 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:59.763095 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7f60888c-dbda-4812-a5ab-7085c7537f46 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:59.764007 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7f60888c-dbda-4812-a5ab-7085c7537f46 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:59.966579 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7f60888c-dbda-4812-a5ab-7085c7537f46 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:11:59.967707 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8aa7e480-1802-4378-a5a8-cf1d329c881a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:11:59.968351 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8aa7e480-1802-4378-a5a8-cf1d329c881a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:11:59.970272 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:11:59.975792 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7f60888c-dbda-4812-a5ab-7085c7537f46 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.232830 Aug 03 12:11:59.975989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8aa7e480-1802-4378-a5a8-cf1d329c881a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:59.976359 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8aa7e480-1802-4378-a5a8-cf1d329c881a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:11:59.976515 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 47/99] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:59 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:11:59.977121 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8aa7e480-1802-4378-a5a8-cf1d329c881a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:11:59.977546 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8aa7e480-1802-4378-a5a8-cf1d329c881a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:00.121961 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8aa7e480-1802-4378-a5a8-cf1d329c881a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:00.129520 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8aa7e480-1802-4378-a5a8-cf1d329c881a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.166288 Aug 03 12:12:00.130103 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 53/100] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:11:59 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:00.455272 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cb7eb3dc-beae-4853-9925-314f05a7b05b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:00.455902 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-cb7eb3dc-beae-4853-9925-314f05a7b05b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:00.462765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cb7eb3dc-beae-4853-9925-314f05a7b05b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:00.463253 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cb7eb3dc-beae-4853-9925-314f05a7b05b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:00.464601 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cb7eb3dc-beae-4853-9925-314f05a7b05b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:00.465045 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cb7eb3dc-beae-4853-9925-314f05a7b05b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:00.469873 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=100 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:00.612482 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cb7eb3dc-beae-4853-9925-314f05a7b05b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:00.621299 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cb7eb3dc-beae-4853-9925-314f05a7b05b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:00.622866 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cb7eb3dc-beae-4853-9925-314f05a7b05b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:00.623992 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-cb7eb3dc-beae-4853-9925-314f05a7b05b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.173165 Aug 03 12:12:00.624567 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 48/101] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:00 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:00.783408 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-edb8efe7-0841-4915-b01c-c70de2954875 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:00.784006 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-edb8efe7-0841-4915-b01c-c70de2954875 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:00.797946 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-edb8efe7-0841-4915-b01c-c70de2954875 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:00.798711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-edb8efe7-0841-4915-b01c-c70de2954875 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:00.799295 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-edb8efe7-0841-4915-b01c-c70de2954875 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:00.799743 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-edb8efe7-0841-4915-b01c-c70de2954875 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:00.965010 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-edb8efe7-0841-4915-b01c-c70de2954875 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:00.975873 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-edb8efe7-0841-4915-b01c-c70de2954875 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.196372 Aug 03 12:12:00.976469 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 54/102] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:00 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:00.998658 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a7fa1571-50d8-49c3-a04b-ed034a38f457 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:00.999477 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a7fa1571-50d8-49c3-a04b-ed034a38f457 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:01.006286 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a7fa1571-50d8-49c3-a04b-ed034a38f457 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:01.006803 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a7fa1571-50d8-49c3-a04b-ed034a38f457 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:01.007627 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a7fa1571-50d8-49c3-a04b-ed034a38f457 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:01.008071 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a7fa1571-50d8-49c3-a04b-ed034a38f457 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:01.155456 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-018533d7-c40e-4eb3-8d50-d535ab64a9b5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:01.156647 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-018533d7-c40e-4eb3-8d50-d535ab64a9b5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:01.167846 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-018533d7-c40e-4eb3-8d50-d535ab64a9b5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:01.168728 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-018533d7-c40e-4eb3-8d50-d535ab64a9b5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:01.170238 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-018533d7-c40e-4eb3-8d50-d535ab64a9b5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:01.171175 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-018533d7-c40e-4eb3-8d50-d535ab64a9b5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:01.176299 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a7fa1571-50d8-49c3-a04b-ed034a38f457 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:01.184834 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a7fa1571-50d8-49c3-a04b-ed034a38f457 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.191036 Aug 03 12:12:01.185435 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 49/103] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:00 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:01.365894 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-018533d7-c40e-4eb3-8d50-d535ab64a9b5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:01.382945 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-018533d7-c40e-4eb3-8d50-d535ab64a9b5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.235158 Aug 03 12:12:01.384687 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 55/104] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:01 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:01.647944 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4c57b245-033b-40ef-bed5-f924b634a084 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:01.648454 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-4c57b245-033b-40ef-bed5-f924b634a084 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:01.655880 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4c57b245-033b-40ef-bed5-f924b634a084 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:01.656374 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4c57b245-033b-40ef-bed5-f924b634a084 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:01.657217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4c57b245-033b-40ef-bed5-f924b634a084 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:01.657699 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4c57b245-033b-40ef-bed5-f924b634a084 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:01.852633 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-4c57b245-033b-40ef-bed5-f924b634a084 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:01.866416 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-4c57b245-033b-40ef-bed5-f924b634a084 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:01.868226 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-4c57b245-033b-40ef-bed5-f924b634a084 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:01.869398 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-4c57b245-033b-40ef-bed5-f924b634a084 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.225766 Aug 03 12:12:01.869974 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 50/105] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:01 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:12:01.999338 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5de8a4d8-d044-4b60-bc97-5e7e0e5b7404 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:02.000164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5de8a4d8-d044-4b60-bc97-5e7e0e5b7404 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:02.006605 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5de8a4d8-d044-4b60-bc97-5e7e0e5b7404 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:02.007041 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5de8a4d8-d044-4b60-bc97-5e7e0e5b7404 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:02.007825 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5de8a4d8-d044-4b60-bc97-5e7e0e5b7404 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:02.008259 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5de8a4d8-d044-4b60-bc97-5e7e0e5b7404 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:02.183876 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5de8a4d8-d044-4b60-bc97-5e7e0e5b7404 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:02.191993 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5de8a4d8-d044-4b60-bc97-5e7e0e5b7404 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.196655 Aug 03 12:12:02.192722 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 56/106] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:01 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:02.219557 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-18367cfd-3027-4e33-9a9b-877acec16c15 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:02.220327 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-18367cfd-3027-4e33-9a9b-877acec16c15 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:02.229738 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-18367cfd-3027-4e33-9a9b-877acec16c15 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:02.230239 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-18367cfd-3027-4e33-9a9b-877acec16c15 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:02.231257 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-18367cfd-3027-4e33-9a9b-877acec16c15 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:02.231735 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-18367cfd-3027-4e33-9a9b-877acec16c15 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:02.413951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-497cbd94-4daa-4195-9788-4d97dea25e99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:02.415065 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-497cbd94-4daa-4195-9788-4d97dea25e99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:02.421469 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-18367cfd-3027-4e33-9a9b-877acec16c15 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:02.429155 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-497cbd94-4daa-4195-9788-4d97dea25e99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:02.429927 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-497cbd94-4daa-4195-9788-4d97dea25e99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:02.430512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-18367cfd-3027-4e33-9a9b-877acec16c15 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.214773 Aug 03 12:12:02.431448 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 51/107] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:02 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:02.431727 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-497cbd94-4daa-4195-9788-4d97dea25e99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:02.442050 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-497cbd94-4daa-4195-9788-4d97dea25e99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:02.636763 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-497cbd94-4daa-4195-9788-4d97dea25e99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:02.644881 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-497cbd94-4daa-4195-9788-4d97dea25e99 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.238169 Aug 03 12:12:02.645470 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 57/108] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:02 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:02.895544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a428a6fd-58fb-4d0f-9d85-b236c538b86e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:02.896592 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a428a6fd-58fb-4d0f-9d85-b236c538b86e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:02.907587 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a428a6fd-58fb-4d0f-9d85-b236c538b86e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:02.908328 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a428a6fd-58fb-4d0f-9d85-b236c538b86e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:02.909598 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a428a6fd-58fb-4d0f-9d85-b236c538b86e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:02.910269 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a428a6fd-58fb-4d0f-9d85-b236c538b86e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:03.055088 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a428a6fd-58fb-4d0f-9d85-b236c538b86e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:03.064066 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a428a6fd-58fb-4d0f-9d85-b236c538b86e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:03.065593 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a428a6fd-58fb-4d0f-9d85-b236c538b86e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:03.066752 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a428a6fd-58fb-4d0f-9d85-b236c538b86e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.178394 Aug 03 12:12:03.067333 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 52/109] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:02 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:03.214574 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ca7136b8-32a4-4aac-8dad-eacf6c85c746 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:03.215205 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ca7136b8-32a4-4aac-8dad-eacf6c85c746 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:03.224230 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ca7136b8-32a4-4aac-8dad-eacf6c85c746 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:03.224950 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ca7136b8-32a4-4aac-8dad-eacf6c85c746 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:03.226315 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ca7136b8-32a4-4aac-8dad-eacf6c85c746 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:03.227127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ca7136b8-32a4-4aac-8dad-eacf6c85c746 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:03.376983 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ca7136b8-32a4-4aac-8dad-eacf6c85c746 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:03.384520 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ca7136b8-32a4-4aac-8dad-eacf6c85c746 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.174521 Aug 03 12:12:03.385962 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 58/110] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:03 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:03.453335 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a7bb38a7-3f33-4c7f-af18-28f106cb13ee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:03.453945 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a7bb38a7-3f33-4c7f-af18-28f106cb13ee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:03.460069 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a7bb38a7-3f33-4c7f-af18-28f106cb13ee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:03.460514 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a7bb38a7-3f33-4c7f-af18-28f106cb13ee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:03.461272 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a7bb38a7-3f33-4c7f-af18-28f106cb13ee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:03.461707 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a7bb38a7-3f33-4c7f-af18-28f106cb13ee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:03.617121 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a7bb38a7-3f33-4c7f-af18-28f106cb13ee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:03.624985 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a7bb38a7-3f33-4c7f-af18-28f106cb13ee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.175438 Aug 03 12:12:03.625568 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 53/111] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:03 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:03.665617 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1332d17b-1ab2-4a53-a8af-46beb9ea9a8a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:03.666305 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1332d17b-1ab2-4a53-a8af-46beb9ea9a8a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:03.672610 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1332d17b-1ab2-4a53-a8af-46beb9ea9a8a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:03.673048 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1332d17b-1ab2-4a53-a8af-46beb9ea9a8a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:03.673818 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1332d17b-1ab2-4a53-a8af-46beb9ea9a8a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:03.674247 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1332d17b-1ab2-4a53-a8af-46beb9ea9a8a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:03.841670 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1332d17b-1ab2-4a53-a8af-46beb9ea9a8a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:03.849594 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1332d17b-1ab2-4a53-a8af-46beb9ea9a8a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.187716 Aug 03 12:12:03.850193 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 59/112] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:03 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:04.089813 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-dba4ad61-c5a1-4784-8256-d865163dc301 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:04.090567 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-dba4ad61-c5a1-4784-8256-d865163dc301 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:04.100485 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dba4ad61-c5a1-4784-8256-d865163dc301 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:04.100932 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dba4ad61-c5a1-4784-8256-d865163dc301 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:04.101720 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dba4ad61-c5a1-4784-8256-d865163dc301 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:04.102157 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dba4ad61-c5a1-4784-8256-d865163dc301 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:04.245309 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dba4ad61-c5a1-4784-8256-d865163dc301 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:04.256865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dba4ad61-c5a1-4784-8256-d865163dc301 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:04.258612 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dba4ad61-c5a1-4784-8256-d865163dc301 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:04.260245 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-dba4ad61-c5a1-4784-8256-d865163dc301 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.174361 Aug 03 12:12:04.261492 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 54/113] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:04 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:04.407977 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0b52d050-13bc-4777-9426-35ae4c58e205 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:04.408764 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0b52d050-13bc-4777-9426-35ae4c58e205 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:04.423062 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b52d050-13bc-4777-9426-35ae4c58e205 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:04.423844 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b52d050-13bc-4777-9426-35ae4c58e205 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:04.424955 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b52d050-13bc-4777-9426-35ae4c58e205 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:04.425495 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b52d050-13bc-4777-9426-35ae4c58e205 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:04.664879 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-172dbb84-f027-4f0f-9e2b-0b9545a73e74 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:04.670795 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-172dbb84-f027-4f0f-9e2b-0b9545a73e74 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:04.707427 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-172dbb84-f027-4f0f-9e2b-0b9545a73e74 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:04.708296 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-172dbb84-f027-4f0f-9e2b-0b9545a73e74 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:04.709911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-172dbb84-f027-4f0f-9e2b-0b9545a73e74 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:04.711226 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-172dbb84-f027-4f0f-9e2b-0b9545a73e74 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:04.725140 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0b52d050-13bc-4777-9426-35ae4c58e205 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:04.738353 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0b52d050-13bc-4777-9426-35ae4c58e205 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.332827 Aug 03 12:12:04.750502 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 60/114] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:04 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:04.873199 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-126ef41f-0480-4ea8-b935-94ac3c4dd95a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:04.874182 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-126ef41f-0480-4ea8-b935-94ac3c4dd95a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:04.882894 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-126ef41f-0480-4ea8-b935-94ac3c4dd95a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:04.883756 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-126ef41f-0480-4ea8-b935-94ac3c4dd95a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:04.884757 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-126ef41f-0480-4ea8-b935-94ac3c4dd95a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:04.886018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-126ef41f-0480-4ea8-b935-94ac3c4dd95a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:05.097005 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-126ef41f-0480-4ea8-b935-94ac3c4dd95a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:05.112827 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-126ef41f-0480-4ea8-b935-94ac3c4dd95a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.244293 Aug 03 12:12:05.113872 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 61/115] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:04 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:05.206364 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-172dbb84-f027-4f0f-9e2b-0b9545a73e74 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:05.218809 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-172dbb84-f027-4f0f-9e2b-0b9545a73e74 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.565451 Aug 03 12:12:05.219400 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 55/116] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:04 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:05.284594 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4bfa828c-99ea-4958-9ffd-efb97a4f524e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:05.285203 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4bfa828c-99ea-4958-9ffd-efb97a4f524e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:05.291669 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bfa828c-99ea-4958-9ffd-efb97a4f524e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:05.292112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bfa828c-99ea-4958-9ffd-efb97a4f524e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:05.292896 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bfa828c-99ea-4958-9ffd-efb97a4f524e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:05.293326 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4bfa828c-99ea-4958-9ffd-efb97a4f524e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:05.451291 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4bfa828c-99ea-4958-9ffd-efb97a4f524e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:05.459555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4bfa828c-99ea-4958-9ffd-efb97a4f524e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:05.461040 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4bfa828c-99ea-4958-9ffd-efb97a4f524e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:05.462162 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4bfa828c-99ea-4958-9ffd-efb97a4f524e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.181854 Aug 03 12:12:05.462762 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 62/117] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:05 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:12:05.783072 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1efad5df-7895-4ad8-a908-52a3a91bcc46 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:05.786916 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1efad5df-7895-4ad8-a908-52a3a91bcc46 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:05.810020 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1efad5df-7895-4ad8-a908-52a3a91bcc46 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:05.814382 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1efad5df-7895-4ad8-a908-52a3a91bcc46 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:05.819406 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1efad5df-7895-4ad8-a908-52a3a91bcc46 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:05.820848 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1efad5df-7895-4ad8-a908-52a3a91bcc46 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:06.139586 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f6b8a338-db6a-46a5-9b83-9a37a8637847 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:06.144985 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f6b8a338-db6a-46a5-9b83-9a37a8637847 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:06.170201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f6b8a338-db6a-46a5-9b83-9a37a8637847 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:06.174433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f6b8a338-db6a-46a5-9b83-9a37a8637847 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:06.180693 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f6b8a338-db6a-46a5-9b83-9a37a8637847 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:06.184839 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f6b8a338-db6a-46a5-9b83-9a37a8637847 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:06.461582 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1efad5df-7895-4ad8-a908-52a3a91bcc46 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:06.474025 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1efad5df-7895-4ad8-a908-52a3a91bcc46 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.698035 Aug 03 12:12:06.474667 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 56/118] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:05 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:06.485942 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f6b8a338-db6a-46a5-9b83-9a37a8637847 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:06.491492 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:06.496441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5fcf42f8-160c-4272-889e-526a661e38c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:06.497130 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5fcf42f8-160c-4272-889e-526a661e38c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:06.501107 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f6b8a338-db6a-46a5-9b83-9a37a8637847 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.370066 Aug 03 12:12:06.504386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 63/119] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:06 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:06.512182 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9adaa2cb-7f8d-480b-819d-0d1a64d7c992 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:06.512828 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9adaa2cb-7f8d-480b-819d-0d1a64d7c992 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:06.527451 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9adaa2cb-7f8d-480b-819d-0d1a64d7c992 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:06.528415 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9adaa2cb-7f8d-480b-819d-0d1a64d7c992 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:06.528983 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5fcf42f8-160c-4272-889e-526a661e38c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:06.529812 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5fcf42f8-160c-4272-889e-526a661e38c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:06.530390 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9adaa2cb-7f8d-480b-819d-0d1a64d7c992 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:06.538390 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5fcf42f8-160c-4272-889e-526a661e38c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:06.538390 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5fcf42f8-160c-4272-889e-526a661e38c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:06.541070 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9adaa2cb-7f8d-480b-819d-0d1a64d7c992 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:06.782839 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5fcf42f8-160c-4272-889e-526a661e38c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:06.790325 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9adaa2cb-7f8d-480b-819d-0d1a64d7c992 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:06.799248 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9adaa2cb-7f8d-480b-819d-0d1a64d7c992 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:06.800148 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5fcf42f8-160c-4272-889e-526a661e38c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.324016 Aug 03 12:12:06.800900 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9adaa2cb-7f8d-480b-819d-0d1a64d7c992 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:06.801172 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 57/120] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:06 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:06.815635 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9adaa2cb-7f8d-480b-819d-0d1a64d7c992 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.308662 Aug 03 12:12:06.816496 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 64/121] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:06 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:07.512967 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-30a81e36-be5a-416c-bb89-eaf1db43fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:07.514000 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-30a81e36-be5a-416c-bb89-eaf1db43fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:07.529038 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3084b9a6-8e4c-4677-9190-7df9e9029335 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:07.530187 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3084b9a6-8e4c-4677-9190-7df9e9029335 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:07.532301 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-30a81e36-be5a-416c-bb89-eaf1db43fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:07.533648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-30a81e36-be5a-416c-bb89-eaf1db43fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:07.535696 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-30a81e36-be5a-416c-bb89-eaf1db43fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:07.536952 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-30a81e36-be5a-416c-bb89-eaf1db43fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:07.544656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3084b9a6-8e4c-4677-9190-7df9e9029335 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:07.545328 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3084b9a6-8e4c-4677-9190-7df9e9029335 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:07.547565 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3084b9a6-8e4c-4677-9190-7df9e9029335 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:07.548971 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3084b9a6-8e4c-4677-9190-7df9e9029335 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:07.725512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-30a81e36-be5a-416c-bb89-eaf1db43fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:07.738363 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-30a81e36-be5a-416c-bb89-eaf1db43fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.234695 Aug 03 12:12:07.752419 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 58/122] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:07 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:07.769763 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3084b9a6-8e4c-4677-9190-7df9e9029335 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:07.788143 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3084b9a6-8e4c-4677-9190-7df9e9029335 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.264227 Aug 03 12:12:07.789150 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 65/123] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:07 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:07.823138 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-62d75c64-41d2-4cdf-9ad9-3e0880dbc94b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:07.823999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-62d75c64-41d2-4cdf-9ad9-3e0880dbc94b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:07.832701 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-62d75c64-41d2-4cdf-9ad9-3e0880dbc94b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:07.833145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-62d75c64-41d2-4cdf-9ad9-3e0880dbc94b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:07.835573 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-62d75c64-41d2-4cdf-9ad9-3e0880dbc94b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:07.836099 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-62d75c64-41d2-4cdf-9ad9-3e0880dbc94b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:07.844758 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d8ef7598-4a6e-4c28-81e3-c135de4e6929 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:07.845773 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d8ef7598-4a6e-4c28-81e3-c135de4e6929 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:07.854859 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d8ef7598-4a6e-4c28-81e3-c135de4e6929 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:07.855426 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d8ef7598-4a6e-4c28-81e3-c135de4e6929 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:07.856477 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d8ef7598-4a6e-4c28-81e3-c135de4e6929 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:07.857128 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d8ef7598-4a6e-4c28-81e3-c135de4e6929 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:08.071482 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-62d75c64-41d2-4cdf-9ad9-3e0880dbc94b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:08.082122 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-62d75c64-41d2-4cdf-9ad9-3e0880dbc94b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.263780 Aug 03 12:12:08.083961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 59/124] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:07 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:08.152311 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d8ef7598-4a6e-4c28-81e3-c135de4e6929 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:08.164030 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d8ef7598-4a6e-4c28-81e3-c135de4e6929 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:08.165657 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d8ef7598-4a6e-4c28-81e3-c135de4e6929 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:08.166906 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d8ef7598-4a6e-4c28-81e3-c135de4e6929 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.329415 Aug 03 12:12:08.167462 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 66/125] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:07 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:12:08.761422 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-14988418-41d7-4e46-bb81-a1815d298c63 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:08.762279 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-14988418-41d7-4e46-bb81-a1815d298c63 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:08.769947 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-14988418-41d7-4e46-bb81-a1815d298c63 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:08.770918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-14988418-41d7-4e46-bb81-a1815d298c63 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:08.772260 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-14988418-41d7-4e46-bb81-a1815d298c63 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:08.792976 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-14988418-41d7-4e46-bb81-a1815d298c63 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:08.818197 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7920541f-7914-4ad9-bb83-167804dae74f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:08.819274 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7920541f-7914-4ad9-bb83-167804dae74f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:08.829697 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=88 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:08.838876 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7920541f-7914-4ad9-bb83-167804dae74f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:08.839332 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7920541f-7914-4ad9-bb83-167804dae74f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:08.840132 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7920541f-7914-4ad9-bb83-167804dae74f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:08.840569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7920541f-7914-4ad9-bb83-167804dae74f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:08.969415 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-14988418-41d7-4e46-bb81-a1815d298c63 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:08.977929 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-14988418-41d7-4e46-bb81-a1815d298c63 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.221488 Aug 03 12:12:08.980373 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 60/126] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:08 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:09.074069 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7920541f-7914-4ad9-bb83-167804dae74f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:09.089686 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7920541f-7914-4ad9-bb83-167804dae74f tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.278265 Aug 03 12:12:09.091335 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 67/127] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:08 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:09.124016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-9eb0571a-e8e8-428a-9317-6c5f575381dc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:09.125516 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-9eb0571a-e8e8-428a-9317-6c5f575381dc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:09.136247 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9eb0571a-e8e8-428a-9317-6c5f575381dc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:09.137003 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9eb0571a-e8e8-428a-9317-6c5f575381dc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:09.138373 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9eb0571a-e8e8-428a-9317-6c5f575381dc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:09.139486 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9eb0571a-e8e8-428a-9317-6c5f575381dc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:09.209934 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6f8b39ab-5a85-4a25-abba-0007029c89ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:09.210658 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6f8b39ab-5a85-4a25-abba-0007029c89ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:09.221328 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f8b39ab-5a85-4a25-abba-0007029c89ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:09.221783 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f8b39ab-5a85-4a25-abba-0007029c89ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:09.222603 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f8b39ab-5a85-4a25-abba-0007029c89ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:09.223622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f8b39ab-5a85-4a25-abba-0007029c89ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:09.523911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-9eb0571a-e8e8-428a-9317-6c5f575381dc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:09.540113 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-9eb0571a-e8e8-428a-9317-6c5f575381dc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.422790 Aug 03 12:12:09.542178 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 61/128] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:09 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:09.664417 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6f8b39ab-5a85-4a25-abba-0007029c89ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:09.674246 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6f8b39ab-5a85-4a25-abba-0007029c89ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:09.677130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6f8b39ab-5a85-4a25-abba-0007029c89ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:09.678976 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6f8b39ab-5a85-4a25-abba-0007029c89ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.474252 Aug 03 12:12:09.680934 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 68/129] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:09 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:12:10.009949 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-71d989c9-6797-429c-87c7-1bee341a10c9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:10.011883 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-71d989c9-6797-429c-87c7-1bee341a10c9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:10.037122 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=80 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:10.040138 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71d989c9-6797-429c-87c7-1bee341a10c9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:10.040954 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71d989c9-6797-429c-87c7-1bee341a10c9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:10.049442 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71d989c9-6797-429c-87c7-1bee341a10c9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:10.053148 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71d989c9-6797-429c-87c7-1bee341a10c9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:10.128729 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2e2939b3-e690-41eb-b5e7-f240441d049a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:10.131258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2e2939b3-e690-41eb-b5e7-f240441d049a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:10.156373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2e2939b3-e690-41eb-b5e7-f240441d049a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:10.175521 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2e2939b3-e690-41eb-b5e7-f240441d049a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:10.181193 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2e2939b3-e690-41eb-b5e7-f240441d049a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:10.187646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2e2939b3-e690-41eb-b5e7-f240441d049a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:10.593724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2e2939b3-e690-41eb-b5e7-f240441d049a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:10.607999 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2e2939b3-e690-41eb-b5e7-f240441d049a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.486855 Aug 03 12:12:10.611066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 69/130] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:10 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:10.618969 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-28871c34-8053-4a7f-bf8b-cbfbb142aa97 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:10.623179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-28871c34-8053-4a7f-bf8b-cbfbb142aa97 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:10.639603 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-28871c34-8053-4a7f-bf8b-cbfbb142aa97 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:10.640477 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-28871c34-8053-4a7f-bf8b-cbfbb142aa97 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:10.641889 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-28871c34-8053-4a7f-bf8b-cbfbb142aa97 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:10.643367 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-28871c34-8053-4a7f-bf8b-cbfbb142aa97 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:10.729805 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-71d989c9-6797-429c-87c7-1bee341a10c9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:10.747038 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-71d989c9-6797-429c-87c7-1bee341a10c9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.748933 Aug 03 12:12:10.748426 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 62/131] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:09 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:10.755529 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a8590f39-5432-450c-bac7-c2e4069c8b3e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:10.761981 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a8590f39-5432-450c-bac7-c2e4069c8b3e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:10.766243 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a8590f39-5432-450c-bac7-c2e4069c8b3e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:10.767244 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a8590f39-5432-450c-bac7-c2e4069c8b3e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:10.768778 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a8590f39-5432-450c-bac7-c2e4069c8b3e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:10.769458 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a8590f39-5432-450c-bac7-c2e4069c8b3e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:10.943695 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-28871c34-8053-4a7f-bf8b-cbfbb142aa97 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:10.957850 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-28871c34-8053-4a7f-bf8b-cbfbb142aa97 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.344477 Aug 03 12:12:10.973269 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 70/132] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:10 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:11.003479 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a8590f39-5432-450c-bac7-c2e4069c8b3e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:11.016024 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a8590f39-5432-450c-bac7-c2e4069c8b3e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:11.019174 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a8590f39-5432-450c-bac7-c2e4069c8b3e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:11.020523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a8590f39-5432-450c-bac7-c2e4069c8b3e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.270897 Aug 03 12:12:11.021680 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 63/133] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:10 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:11.637604 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-21d95079-a81f-4c54-baab-90990aa52233 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:11.638892 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-21d95079-a81f-4c54-baab-90990aa52233 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:11.645693 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21d95079-a81f-4c54-baab-90990aa52233 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:11.646512 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21d95079-a81f-4c54-baab-90990aa52233 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:11.647512 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21d95079-a81f-4c54-baab-90990aa52233 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:11.648199 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21d95079-a81f-4c54-baab-90990aa52233 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:11.776403 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-afaf7541-2079-47fc-a312-0dafa2a52580 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:11.777115 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-afaf7541-2079-47fc-a312-0dafa2a52580 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:11.788995 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-afaf7541-2079-47fc-a312-0dafa2a52580 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:11.790915 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-afaf7541-2079-47fc-a312-0dafa2a52580 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:11.794393 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-afaf7541-2079-47fc-a312-0dafa2a52580 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:11.800694 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-afaf7541-2079-47fc-a312-0dafa2a52580 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:11.957520 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-21d95079-a81f-4c54-baab-90990aa52233 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:11.973769 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-21d95079-a81f-4c54-baab-90990aa52233 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.340076 Aug 03 12:12:11.977919 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 71/134] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:11 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:12.015564 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-96bec657-4228-4de8-9c4c-31e5323956ed tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:12.016476 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-96bec657-4228-4de8-9c4c-31e5323956ed tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:12.031640 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-96bec657-4228-4de8-9c4c-31e5323956ed tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:12.035284 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-96bec657-4228-4de8-9c4c-31e5323956ed tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:12.036602 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-96bec657-4228-4de8-9c4c-31e5323956ed tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:12.038839 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-96bec657-4228-4de8-9c4c-31e5323956ed tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:12.307980 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-96bec657-4228-4de8-9c4c-31e5323956ed tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:12.319263 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-96bec657-4228-4de8-9c4c-31e5323956ed tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.323784 Aug 03 12:12:12.322195 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 72/135] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:11 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:12.334640 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9a2f16d3-4eeb-4c1f-bf6c-469be828a83d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:12.335263 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9a2f16d3-4eeb-4c1f-bf6c-469be828a83d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:12.345086 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-afaf7541-2079-47fc-a312-0dafa2a52580 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:12.349447 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a2f16d3-4eeb-4c1f-bf6c-469be828a83d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:12.350124 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a2f16d3-4eeb-4c1f-bf6c-469be828a83d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:12.351808 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a2f16d3-4eeb-4c1f-bf6c-469be828a83d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:12.352607 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a2f16d3-4eeb-4c1f-bf6c-469be828a83d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:12.353471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=100 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:12.361395 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-afaf7541-2079-47fc-a312-0dafa2a52580 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.590111 Aug 03 12:12:12.363678 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 64/136] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:11 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:12.610850 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9a2f16d3-4eeb-4c1f-bf6c-469be828a83d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:12.624630 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9a2f16d3-4eeb-4c1f-bf6c-469be828a83d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:12.627429 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9a2f16d3-4eeb-4c1f-bf6c-469be828a83d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:12.629790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9a2f16d3-4eeb-4c1f-bf6c-469be828a83d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.304857 Aug 03 12:12:12.642319 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 73/137] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:12 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:12.661635 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-3685ff16-f5a7-49ae-b6fc-bfd9950a8443 req-6c447b36-0976-4e1e-a2bf-eb80765d8a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edbf4859-738e-4993-8a7a-006a27c69279", "name": "network-vif-plugged", "status": "completed", "tag": "0c84946e-8f0e-48e4-a558-b8ad74fc5016"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:12:12.700108 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-3685ff16-f5a7-49ae-b6fc-bfd9950a8443 req-6c447b36-0976-4e1e-a2bf-eb80765d8a65 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:12.702371 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-3685ff16-f5a7-49ae-b6fc-bfd9950a8443 req-6c447b36-0976-4e1e-a2bf-eb80765d8a65 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:12.731502 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-3685ff16-f5a7-49ae-b6fc-bfd9950a8443 req-6c447b36-0976-4e1e-a2bf-eb80765d8a65 service nova] Creating event network-vif-plugged:0c84946e-8f0e-48e4-a558-b8ad74fc5016 for instance edbf4859-738e-4993-8a7a-006a27c69279 on hv-cinder-83602 Aug 03 12:12:12.745459 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-3685ff16-f5a7-49ae-b6fc-bfd9950a8443 req-6c447b36-0976-4e1e-a2bf-eb80765d8a65 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.379791 Aug 03 12:12:12.761928 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 65/138] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:12:13.004378 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3ec24c7d-d2ca-4f9b-abd5-5f31dae61ac5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:13.004992 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3ec24c7d-d2ca-4f9b-abd5-5f31dae61ac5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:13.020579 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3ec24c7d-d2ca-4f9b-abd5-5f31dae61ac5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:13.021035 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3ec24c7d-d2ca-4f9b-abd5-5f31dae61ac5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:13.021838 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3ec24c7d-d2ca-4f9b-abd5-5f31dae61ac5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:13.022260 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3ec24c7d-d2ca-4f9b-abd5-5f31dae61ac5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:13.251192 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3ec24c7d-d2ca-4f9b-abd5-5f31dae61ac5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:13.264810 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3ec24c7d-d2ca-4f9b-abd5-5f31dae61ac5 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.261119 Aug 03 12:12:13.276105 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 74/139] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:12 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:13.345716 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ee2b28b1-3a52-4927-95ae-e9989a6e0479 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:13.346393 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-ee2b28b1-3a52-4927-95ae-e9989a6e0479 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:13.354839 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ee2b28b1-3a52-4927-95ae-e9989a6e0479 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:13.355320 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ee2b28b1-3a52-4927-95ae-e9989a6e0479 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:13.356415 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ee2b28b1-3a52-4927-95ae-e9989a6e0479 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:13.356684 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ee2b28b1-3a52-4927-95ae-e9989a6e0479 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:13.398788 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c670d0e5-7f93-4801-bdb1-1a633b2ccfbf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:13.401802 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c670d0e5-7f93-4801-bdb1-1a633b2ccfbf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:13.416028 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c670d0e5-7f93-4801-bdb1-1a633b2ccfbf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:13.417789 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c670d0e5-7f93-4801-bdb1-1a633b2ccfbf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:13.419315 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c670d0e5-7f93-4801-bdb1-1a633b2ccfbf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:13.420516 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c670d0e5-7f93-4801-bdb1-1a633b2ccfbf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:13.607136 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ee2b28b1-3a52-4927-95ae-e9989a6e0479 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:13.616444 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ee2b28b1-3a52-4927-95ae-e9989a6e0479 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.276312 Aug 03 12:12:13.627551 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c670d0e5-7f93-4801-bdb1-1a633b2ccfbf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:13.629972 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 66/140] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:13 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:13.645763 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c670d0e5-7f93-4801-bdb1-1a633b2ccfbf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.254262 Aug 03 12:12:13.647106 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 75/141] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:13 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:13.660257 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-975efb7c-a94b-49d4-9971-520bd9771553 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:13.661063 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-975efb7c-a94b-49d4-9971-520bd9771553 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:13.669560 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-975efb7c-a94b-49d4-9971-520bd9771553 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:13.670256 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-975efb7c-a94b-49d4-9971-520bd9771553 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:13.671090 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-975efb7c-a94b-49d4-9971-520bd9771553 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:13.671540 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-975efb7c-a94b-49d4-9971-520bd9771553 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:13.847654 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-975efb7c-a94b-49d4-9971-520bd9771553 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:13.861160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-975efb7c-a94b-49d4-9971-520bd9771553 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:13.866046 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-975efb7c-a94b-49d4-9971-520bd9771553 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:13.867259 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-975efb7c-a94b-49d4-9971-520bd9771553 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.212232 Aug 03 12:12:13.867837 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 67/142] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:13 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:12:14.283788 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fc523715-c206-4c3d-b6a9-3796c8bfd1cd tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:14.284398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fc523715-c206-4c3d-b6a9-3796c8bfd1cd tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:14.291417 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fc523715-c206-4c3d-b6a9-3796c8bfd1cd tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:14.292101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fc523715-c206-4c3d-b6a9-3796c8bfd1cd tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:14.293021 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fc523715-c206-4c3d-b6a9-3796c8bfd1cd tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:14.293637 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fc523715-c206-4c3d-b6a9-3796c8bfd1cd tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:14.495174 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-fc523715-c206-4c3d-b6a9-3796c8bfd1cd tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:14.508084 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-fc523715-c206-4c3d-b6a9-3796c8bfd1cd tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.224742 Aug 03 12:12:14.508084 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 76/143] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:14 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:14.637625 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6579118e-3744-4f89-a815-8f6828d2402a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:14.638410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-6579118e-3744-4f89-a815-8f6828d2402a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:14.645526 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6579118e-3744-4f89-a815-8f6828d2402a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:14.646017 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6579118e-3744-4f89-a815-8f6828d2402a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:14.646828 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6579118e-3744-4f89-a815-8f6828d2402a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:14.647263 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6579118e-3744-4f89-a815-8f6828d2402a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:14.670353 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-133ae25a-f2d2-42ec-8718-afa3ce039c0c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:14.671068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-133ae25a-f2d2-42ec-8718-afa3ce039c0c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:14.677901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-133ae25a-f2d2-42ec-8718-afa3ce039c0c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:14.678433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-133ae25a-f2d2-42ec-8718-afa3ce039c0c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:14.679422 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-133ae25a-f2d2-42ec-8718-afa3ce039c0c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:14.679890 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-133ae25a-f2d2-42ec-8718-afa3ce039c0c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:14.839130 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-6579118e-3744-4f89-a815-8f6828d2402a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:14.852744 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6579118e-3744-4f89-a815-8f6828d2402a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.219033 Aug 03 12:12:14.853568 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 68/144] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:14 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:14.859931 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-d8ac1303-6bf3-4d44-8ae3-0139aff8c511 req-d8758339-5b63-4892-b746-0d7c756fcc25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dec6dd8-d607-422d-a774-65c4288a977a", "name": "network-vif-plugged", "status": "completed", "tag": "d73c6302-a297-4802-acac-097c970a6da3"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:12:14.864946 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-133ae25a-f2d2-42ec-8718-afa3ce039c0c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:14.885859 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-133ae25a-f2d2-42ec-8718-afa3ce039c0c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.220817 Aug 03 12:12:14.886681 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 77/145] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:14 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:14.895393 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5c37e080-e228-4219-941e-16b87812e4d8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:14.896019 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5c37e080-e228-4219-941e-16b87812e4d8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:14.902236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-d8ac1303-6bf3-4d44-8ae3-0139aff8c511 req-d8758339-5b63-4892-b746-0d7c756fcc25 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:14.902720 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-d8ac1303-6bf3-4d44-8ae3-0139aff8c511 req-d8758339-5b63-4892-b746-0d7c756fcc25 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:14.912659 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5c37e080-e228-4219-941e-16b87812e4d8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:14.913114 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5c37e080-e228-4219-941e-16b87812e4d8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:14.919945 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5c37e080-e228-4219-941e-16b87812e4d8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:14.920568 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5c37e080-e228-4219-941e-16b87812e4d8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:14.921144 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-d8ac1303-6bf3-4d44-8ae3-0139aff8c511 req-d8758339-5b63-4892-b746-0d7c756fcc25 service nova] Creating event network-vif-plugged:d73c6302-a297-4802-acac-097c970a6da3 for instance 2dec6dd8-d607-422d-a774-65c4288a977a on hv-cinder-83602 Aug 03 12:12:14.927090 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-d8ac1303-6bf3-4d44-8ae3-0139aff8c511 req-d8758339-5b63-4892-b746-0d7c756fcc25 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072057 Aug 03 12:12:14.928690 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 69/146] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:12:15.100123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5c37e080-e228-4219-941e-16b87812e4d8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:15.116689 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5c37e080-e228-4219-941e-16b87812e4d8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:15.118803 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5c37e080-e228-4219-941e-16b87812e4d8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:15.120673 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5c37e080-e228-4219-941e-16b87812e4d8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.229307 Aug 03 12:12:15.122363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 78/147] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:14 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:15.526909 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d86ccb36-813b-4308-a50f-ab2b94407809 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:15.527611 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d86ccb36-813b-4308-a50f-ab2b94407809 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:15.533862 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d86ccb36-813b-4308-a50f-ab2b94407809 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:15.534155 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d86ccb36-813b-4308-a50f-ab2b94407809 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:15.534958 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d86ccb36-813b-4308-a50f-ab2b94407809 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:15.535396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d86ccb36-813b-4308-a50f-ab2b94407809 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:15.677570 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d86ccb36-813b-4308-a50f-ab2b94407809 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:15.687060 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d86ccb36-813b-4308-a50f-ab2b94407809 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.164304 Aug 03 12:12:15.687782 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 70/148] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:15 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:15.895308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a376fe21-80a6-41ef-97c5-f805b5a2425a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:15.896257 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a376fe21-80a6-41ef-97c5-f805b5a2425a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:15.906605 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a376fe21-80a6-41ef-97c5-f805b5a2425a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:15.907326 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a376fe21-80a6-41ef-97c5-f805b5a2425a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:15.908711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a376fe21-80a6-41ef-97c5-f805b5a2425a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:15.909492 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a376fe21-80a6-41ef-97c5-f805b5a2425a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:15.922383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d4359e02-4d7c-48d3-b1a0-fb895d417b01 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:15.923846 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d4359e02-4d7c-48d3-b1a0-fb895d417b01 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:15.934055 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d4359e02-4d7c-48d3-b1a0-fb895d417b01 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:15.934910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d4359e02-4d7c-48d3-b1a0-fb895d417b01 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:15.936847 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d4359e02-4d7c-48d3-b1a0-fb895d417b01 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:15.937708 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d4359e02-4d7c-48d3-b1a0-fb895d417b01 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:16.111621 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d4359e02-4d7c-48d3-b1a0-fb895d417b01 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:16.126396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d4359e02-4d7c-48d3-b1a0-fb895d417b01 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.209865 Aug 03 12:12:16.132046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a376fe21-80a6-41ef-97c5-f805b5a2425a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:16.137676 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 71/149] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:15 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:16.145263 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f91805d4-74bd-48d5-bdb0-74ee6254cf81 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:16.146252 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f91805d4-74bd-48d5-bdb0-74ee6254cf81 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:16.149523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a376fe21-80a6-41ef-97c5-f805b5a2425a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.259406 Aug 03 12:12:16.151017 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 79/150] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:15 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:16.156225 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f91805d4-74bd-48d5-bdb0-74ee6254cf81 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:16.156943 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f91805d4-74bd-48d5-bdb0-74ee6254cf81 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:16.157800 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f91805d4-74bd-48d5-bdb0-74ee6254cf81 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:16.158271 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f91805d4-74bd-48d5-bdb0-74ee6254cf81 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:16.356932 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f91805d4-74bd-48d5-bdb0-74ee6254cf81 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:16.365469 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f91805d4-74bd-48d5-bdb0-74ee6254cf81 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:16.367053 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f91805d4-74bd-48d5-bdb0-74ee6254cf81 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:16.368232 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f91805d4-74bd-48d5-bdb0-74ee6254cf81 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.227503 Aug 03 12:12:16.368819 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 72/151] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:16 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:12:16.709399 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-677cccf2-9d51-4ce7-9d6f-bde07a285b25 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:16.709399 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-677cccf2-9d51-4ce7-9d6f-bde07a285b25 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:16.716912 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-677cccf2-9d51-4ce7-9d6f-bde07a285b25 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:16.717360 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-677cccf2-9d51-4ce7-9d6f-bde07a285b25 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:16.718124 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-677cccf2-9d51-4ce7-9d6f-bde07a285b25 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:16.718767 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-677cccf2-9d51-4ce7-9d6f-bde07a285b25 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:16.739226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:16.887711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-677cccf2-9d51-4ce7-9d6f-bde07a285b25 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:16.899259 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-677cccf2-9d51-4ce7-9d6f-bde07a285b25 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.194111 Aug 03 12:12:16.901472 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 80/152] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:16 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:17.159072 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a1e82019-5308-4f32-bfa8-6d5166b2b49d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:17.160281 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a1e82019-5308-4f32-bfa8-6d5166b2b49d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:17.168294 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a1e82019-5308-4f32-bfa8-6d5166b2b49d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:17.168854 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a1e82019-5308-4f32-bfa8-6d5166b2b49d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:17.169684 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a1e82019-5308-4f32-bfa8-6d5166b2b49d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:17.170133 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a1e82019-5308-4f32-bfa8-6d5166b2b49d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:17.177753 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1b9c8b0a-b37e-487d-938c-c06f35be9104 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:17.179202 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1b9c8b0a-b37e-487d-938c-c06f35be9104 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:17.190484 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1b9c8b0a-b37e-487d-938c-c06f35be9104 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:17.191222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1b9c8b0a-b37e-487d-938c-c06f35be9104 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:17.205828 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1b9c8b0a-b37e-487d-938c-c06f35be9104 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:17.206290 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1b9c8b0a-b37e-487d-938c-c06f35be9104 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:17.379289 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1b9c8b0a-b37e-487d-938c-c06f35be9104 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:17.380875 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a1e82019-5308-4f32-bfa8-6d5166b2b49d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:17.404261 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a1e82019-5308-4f32-bfa8-6d5166b2b49d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.249199 Aug 03 12:12:17.420563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 73/153] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:17 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:17.427410 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1b9c8b0a-b37e-487d-938c-c06f35be9104 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.256097 Aug 03 12:12:17.437639 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 81/154] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:17 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:17.445491 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e8328d59-f6cf-4959-b8eb-2683515efe43 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:17.446723 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e8328d59-f6cf-4959-b8eb-2683515efe43 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:17.464801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e8328d59-f6cf-4959-b8eb-2683515efe43 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:17.465572 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e8328d59-f6cf-4959-b8eb-2683515efe43 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:17.466734 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e8328d59-f6cf-4959-b8eb-2683515efe43 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:17.467377 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e8328d59-f6cf-4959-b8eb-2683515efe43 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:17.704460 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e8328d59-f6cf-4959-b8eb-2683515efe43 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:17.714505 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e8328d59-f6cf-4959-b8eb-2683515efe43 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:17.716212 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e8328d59-f6cf-4959-b8eb-2683515efe43 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:17.717482 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e8328d59-f6cf-4959-b8eb-2683515efe43 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.283981 Aug 03 12:12:17.718130 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 74/155] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:17 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:17.929435 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d93b3a2f-19b6-42cf-804d-60e66b8eb197 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:17.930310 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d93b3a2f-19b6-42cf-804d-60e66b8eb197 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:17.942876 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d93b3a2f-19b6-42cf-804d-60e66b8eb197 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:17.943309 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d93b3a2f-19b6-42cf-804d-60e66b8eb197 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:17.944286 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d93b3a2f-19b6-42cf-804d-60e66b8eb197 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:17.947962 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d93b3a2f-19b6-42cf-804d-60e66b8eb197 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:18.273200 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d93b3a2f-19b6-42cf-804d-60e66b8eb197 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:18.287540 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d93b3a2f-19b6-42cf-804d-60e66b8eb197 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1314 microversion: 2.1 time: 0.360569 Aug 03 12:12:18.294608 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 82/156] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:17 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:18.450799 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-acb27410-fd43-43fc-96de-bd7b2e2f5049 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:18.451799 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-acb27410-fd43-43fc-96de-bd7b2e2f5049 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:18.471181 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bb12546f-b8c0-4b76-8fd6-9946849a59fb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:18.471616 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bb12546f-b8c0-4b76-8fd6-9946849a59fb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:18.471885 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-acb27410-fd43-43fc-96de-bd7b2e2f5049 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:18.473113 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-acb27410-fd43-43fc-96de-bd7b2e2f5049 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:18.474888 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-acb27410-fd43-43fc-96de-bd7b2e2f5049 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:18.476722 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-acb27410-fd43-43fc-96de-bd7b2e2f5049 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:18.489029 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bb12546f-b8c0-4b76-8fd6-9946849a59fb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:18.489848 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bb12546f-b8c0-4b76-8fd6-9946849a59fb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:18.491452 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bb12546f-b8c0-4b76-8fd6-9946849a59fb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:18.492606 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bb12546f-b8c0-4b76-8fd6-9946849a59fb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:18.803956 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bb12546f-b8c0-4b76-8fd6-9946849a59fb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:18.819362 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bb12546f-b8c0-4b76-8fd6-9946849a59fb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.356245 Aug 03 12:12:18.820397 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 83/157] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:18 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:18.840143 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8f21e7cc-ea1f-4c25-9798-901547a2dc8e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:18.841791 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8f21e7cc-ea1f-4c25-9798-901547a2dc8e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:18.857226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f21e7cc-ea1f-4c25-9798-901547a2dc8e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:18.858346 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f21e7cc-ea1f-4c25-9798-901547a2dc8e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:18.860029 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f21e7cc-ea1f-4c25-9798-901547a2dc8e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:18.861231 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f21e7cc-ea1f-4c25-9798-901547a2dc8e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:18.925310 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-acb27410-fd43-43fc-96de-bd7b2e2f5049 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:18.939716 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-acb27410-fd43-43fc-96de-bd7b2e2f5049 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.497537 Aug 03 12:12:18.940986 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 75/158] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:18 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:19.142045 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8f21e7cc-ea1f-4c25-9798-901547a2dc8e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:19.158719 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8f21e7cc-ea1f-4c25-9798-901547a2dc8e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:19.163037 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8f21e7cc-ea1f-4c25-9798-901547a2dc8e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:19.166169 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8f21e7cc-ea1f-4c25-9798-901547a2dc8e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.343273 Aug 03 12:12:19.176771 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 84/159] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:18 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:19.314382 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-252bd0b1-0f3f-4e33-8cc4-d86052e3f9b7 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:19.315170 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-252bd0b1-0f3f-4e33-8cc4-d86052e3f9b7 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:19.328937 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-252bd0b1-0f3f-4e33-8cc4-d86052e3f9b7 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:19.331283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-252bd0b1-0f3f-4e33-8cc4-d86052e3f9b7 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:19.334109 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-252bd0b1-0f3f-4e33-8cc4-d86052e3f9b7 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:19.336033 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-252bd0b1-0f3f-4e33-8cc4-d86052e3f9b7 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:19.767943 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-252bd0b1-0f3f-4e33-8cc4-d86052e3f9b7 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:19.825010 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-252bd0b1-0f3f-4e33-8cc4-d86052e3f9b7 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1501 microversion: 2.1 time: 0.515308 Aug 03 12:12:19.837354 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 76/160] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:19 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1501 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:19.877074 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-11b73c12-b026-49b4-adc4-2967d26fe333 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:19.878285 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-11b73c12-b026-49b4-adc4-2967d26fe333 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:19.918637 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-11b73c12-b026-49b4-adc4-2967d26fe333 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:19.919446 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-11b73c12-b026-49b4-adc4-2967d26fe333 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:19.920930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-11b73c12-b026-49b4-adc4-2967d26fe333 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:19.927626 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-11b73c12-b026-49b4-adc4-2967d26fe333 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:19.979200 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5703d00f-c28b-49c5-b9a9-de3030598314 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:19.979887 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5703d00f-c28b-49c5-b9a9-de3030598314 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:20.008486 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5703d00f-c28b-49c5-b9a9-de3030598314 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:20.009010 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5703d00f-c28b-49c5-b9a9-de3030598314 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:20.010361 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5703d00f-c28b-49c5-b9a9-de3030598314 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:20.044692 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5703d00f-c28b-49c5-b9a9-de3030598314 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:20.407757 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-11b73c12-b026-49b4-adc4-2967d26fe333 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:20.427180 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-11b73c12-b026-49b4-adc4-2967d26fe333 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.586333 Aug 03 12:12:20.428113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 85/161] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:19 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:20.445465 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a3ff76df-1261-46b8-bf09-0fe3d97b7fb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:20.446430 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a3ff76df-1261-46b8-bf09-0fe3d97b7fb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:20.456158 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a3ff76df-1261-46b8-bf09-0fe3d97b7fb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:20.456892 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a3ff76df-1261-46b8-bf09-0fe3d97b7fb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:20.457914 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a3ff76df-1261-46b8-bf09-0fe3d97b7fb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:20.458670 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a3ff76df-1261-46b8-bf09-0fe3d97b7fb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:20.568711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5703d00f-c28b-49c5-b9a9-de3030598314 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:20.594099 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5703d00f-c28b-49c5-b9a9-de3030598314 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.622142 Aug 03 12:12:20.599821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 77/162] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:19 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:20.639109 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-7eef734d-c05d-40b5-8b26-bdd69029aff2 req-01a95e3e-0173-4f54-a53e-bcf1de69c131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf9a529-07b3-4797-bc51-75b210ae9933", "name": "network-vif-plugged", "status": "completed", "tag": "d86d0e52-6fc7-4559-85a8-02b7160a4f64"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:12:20.673839 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-7eef734d-c05d-40b5-8b26-bdd69029aff2 req-01a95e3e-0173-4f54-a53e-bcf1de69c131 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:20.675609 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-7eef734d-c05d-40b5-8b26-bdd69029aff2 req-01a95e3e-0173-4f54-a53e-bcf1de69c131 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:20.709913 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-7eef734d-c05d-40b5-8b26-bdd69029aff2 req-01a95e3e-0173-4f54-a53e-bcf1de69c131 service nova] Creating event network-vif-plugged:d86d0e52-6fc7-4559-85a8-02b7160a4f64 for instance abf9a529-07b3-4797-bc51-75b210ae9933 on hv-cinder-83602 Aug 03 12:12:20.741412 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-7eef734d-c05d-40b5-8b26-bdd69029aff2 req-01a95e3e-0173-4f54-a53e-bcf1de69c131 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132780 Aug 03 12:12:20.745192 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 78/163] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:12:20.945068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a3ff76df-1261-46b8-bf09-0fe3d97b7fb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:20.983940 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a3ff76df-1261-46b8-bf09-0fe3d97b7fb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:20.999785 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a3ff76df-1261-46b8-bf09-0fe3d97b7fb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:21.006202 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a3ff76df-1261-46b8-bf09-0fe3d97b7fb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.576074 Aug 03 12:12:21.011292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 86/164] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:20 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:21.454964 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-06989968-8fe1-4a46-b46e-10606f2e7875 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:21.457470 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-06989968-8fe1-4a46-b46e-10606f2e7875 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:21.474251 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-06989968-8fe1-4a46-b46e-10606f2e7875 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:21.475392 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-06989968-8fe1-4a46-b46e-10606f2e7875 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:21.478068 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-06989968-8fe1-4a46-b46e-10606f2e7875 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:21.478802 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-06989968-8fe1-4a46-b46e-10606f2e7875 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:21.631929 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ec627eec-672c-4e02-a0ec-dd2a7cccbc95 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:21.633311 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ec627eec-672c-4e02-a0ec-dd2a7cccbc95 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:21.668313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec627eec-672c-4e02-a0ec-dd2a7cccbc95 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:21.668313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec627eec-672c-4e02-a0ec-dd2a7cccbc95 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:21.668313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec627eec-672c-4e02-a0ec-dd2a7cccbc95 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:21.668313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec627eec-672c-4e02-a0ec-dd2a7cccbc95 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:21.800722 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-06989968-8fe1-4a46-b46e-10606f2e7875 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:21.817765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-06989968-8fe1-4a46-b46e-10606f2e7875 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1322 microversion: 2.1 time: 0.371456 Aug 03 12:12:21.819310 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 79/165] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:21 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:21.978878 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-317326f0-65c1-4a6e-aa5f-14c316ba80ff tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5da9e1d-4158-4ad2-9e40-1aa679fc7a90"}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:12:21.983863 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-317326f0-65c1-4a6e-aa5f-14c316ba80ff tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:21.998310 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-317326f0-65c1-4a6e-aa5f-14c316ba80ff tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:21.999751 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-317326f0-65c1-4a6e-aa5f-14c316ba80ff tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:22.001762 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-317326f0-65c1-4a6e-aa5f-14c316ba80ff tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:22.002703 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-317326f0-65c1-4a6e-aa5f-14c316ba80ff tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:22.172630 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ec627eec-672c-4e02-a0ec-dd2a7cccbc95 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:22.204216 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ec627eec-672c-4e02-a0ec-dd2a7cccbc95 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.583371 Aug 03 12:12:22.205566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 87/166] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:21 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:22.225192 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-06630c74-faed-43da-ab96-81d87aaa6131 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:22.227563 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-06630c74-faed-43da-ab96-81d87aaa6131 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:22.256143 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06630c74-faed-43da-ab96-81d87aaa6131 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:22.256912 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06630c74-faed-43da-ab96-81d87aaa6131 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:22.261250 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06630c74-faed-43da-ab96-81d87aaa6131 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:22.262433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06630c74-faed-43da-ab96-81d87aaa6131 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:22.555645 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-06630c74-faed-43da-ab96-81d87aaa6131 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:22.574550 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-06630c74-faed-43da-ab96-81d87aaa6131 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:22.580156 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-06630c74-faed-43da-ab96-81d87aaa6131 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:22.584412 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-06630c74-faed-43da-ab96-81d87aaa6131 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.376875 Aug 03 12:12:22.585846 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 88/167] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:22 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:22.802523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-61944dd5-c926-4fb3-bb10-ae9be5e30aa7 req-c6805ff2-4d67-4c5d-a892-013aae8607ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fedea0ca-7f85-49dc-8459-160418843f05", "name": "network-vif-plugged", "status": "completed", "tag": "1d3fd848-19fd-4089-a319-b9a584a9c430"}, {"server_uuid": "4afb38cd-ec9c-4509-b7c8-91b170684ec5", "name": "network-vif-plugged", "status": "completed", "tag": "8f2969cf-b117-4fef-a2f6-5587992eefda"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:12:22.840130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-61944dd5-c926-4fb3-bb10-ae9be5e30aa7 req-c6805ff2-4d67-4c5d-a892-013aae8607ca service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:22.840701 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-61944dd5-c926-4fb3-bb10-ae9be5e30aa7 req-c6805ff2-4d67-4c5d-a892-013aae8607ca service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:22.861029 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-61944dd5-c926-4fb3-bb10-ae9be5e30aa7 req-c6805ff2-4d67-4c5d-a892-013aae8607ca service nova] Creating event network-vif-plugged:1d3fd848-19fd-4089-a319-b9a584a9c430 for instance fedea0ca-7f85-49dc-8459-160418843f05 on hv-cinder-83602 Aug 03 12:12:22.861615 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-61944dd5-c926-4fb3-bb10-ae9be5e30aa7 req-c6805ff2-4d67-4c5d-a892-013aae8607ca service nova] Creating event network-vif-plugged:8f2969cf-b117-4fef-a2f6-5587992eefda for instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 on hv-cinder-83602 Aug 03 12:12:22.871818 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-61944dd5-c926-4fb3-bb10-ae9be5e30aa7 req-c6805ff2-4d67-4c5d-a892-013aae8607ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083074 Aug 03 12:12:22.873043 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 89/168] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:12:22.879516 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bd115924-104e-4a00-a10c-084a0881b99a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:22.880662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bd115924-104e-4a00-a10c-084a0881b99a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:22.913735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bd115924-104e-4a00-a10c-084a0881b99a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:22.917327 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bd115924-104e-4a00-a10c-084a0881b99a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:22.918529 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bd115924-104e-4a00-a10c-084a0881b99a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:22.920743 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bd115924-104e-4a00-a10c-084a0881b99a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:23.192490 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bd115924-104e-4a00-a10c-084a0881b99a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:23.204600 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bd115924-104e-4a00-a10c-084a0881b99a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1515 microversion: 2.1 time: 0.330226 Aug 03 12:12:23.205899 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 90/169] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:22 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1515 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:23.236558 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-667adc05-2921-4373-b561-b5002d2139c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:12:23.239834 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-667adc05-2921-4373-b561-b5002d2139c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:23.250306 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-667adc05-2921-4373-b561-b5002d2139c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:23.251539 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-667adc05-2921-4373-b561-b5002d2139c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:23.252639 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-667adc05-2921-4373-b561-b5002d2139c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:23.253321 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-667adc05-2921-4373-b561-b5002d2139c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:23.262925 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-317326f0-65c1-4a6e-aa5f-14c316ba80ff tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "POST /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.294971 Aug 03 12:12:23.271646 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 80/170] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:12:21 2022] POST /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279/os-volume_attachments => generated 194 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:12:23.292829 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1373eea3-8aa4-479f-828a-fab52c9ffc5a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:23.300012 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1373eea3-8aa4-479f-828a-fab52c9ffc5a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:23.327445 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1373eea3-8aa4-479f-828a-fab52c9ffc5a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:23.327809 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1373eea3-8aa4-479f-828a-fab52c9ffc5a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:23.341288 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1373eea3-8aa4-479f-828a-fab52c9ffc5a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:23.342345 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1373eea3-8aa4-479f-828a-fab52c9ffc5a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:23.430741 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-667adc05-2921-4373-b561-b5002d2139c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lazy-loading 'flavor' on Instance uuid abf9a529-07b3-4797-bc51-75b210ae9933 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:12:23.596455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-667adc05-2921-4373-b561-b5002d2139c1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "POST /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933/action" status: 200 len: 32 microversion: 2.1 time: 0.364143 Aug 03 12:12:23.611006 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 91/171] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:12:23 2022] POST /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933/action => generated 32 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 12:12:23.623408 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9d9b486e-6b35-4c03-a9bb-a7186181ba1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:23.624576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9d9b486e-6b35-4c03-a9bb-a7186181ba1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:23.633606 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9d9b486e-6b35-4c03-a9bb-a7186181ba1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:23.635550 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9d9b486e-6b35-4c03-a9bb-a7186181ba1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:23.637801 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9d9b486e-6b35-4c03-a9bb-a7186181ba1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:23.639193 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9d9b486e-6b35-4c03-a9bb-a7186181ba1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:23.930050 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9d9b486e-6b35-4c03-a9bb-a7186181ba1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:23.953754 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9d9b486e-6b35-4c03-a9bb-a7186181ba1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:23.955645 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9d9b486e-6b35-4c03-a9bb-a7186181ba1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:23.961868 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9d9b486e-6b35-4c03-a9bb-a7186181ba1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.355297 Aug 03 12:12:23.962981 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 92/172] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:23 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:23.969755 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3492e7a9-8ca4-420e-b9e1-2ded54464213 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:23.975685 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3492e7a9-8ca4-420e-b9e1-2ded54464213 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:24.007657 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3492e7a9-8ca4-420e-b9e1-2ded54464213 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:24.008117 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3492e7a9-8ca4-420e-b9e1-2ded54464213 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:24.009008 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3492e7a9-8ca4-420e-b9e1-2ded54464213 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:24.010339 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3492e7a9-8ca4-420e-b9e1-2ded54464213 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:24.225742 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1373eea3-8aa4-479f-828a-fab52c9ffc5a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:24.296745 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3492e7a9-8ca4-420e-b9e1-2ded54464213 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:24.302286 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1373eea3-8aa4-479f-828a-fab52c9ffc5a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 1.027112 Aug 03 12:12:24.305150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 81/173] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:23 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:24.315063 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3492e7a9-8ca4-420e-b9e1-2ded54464213 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.350952 Aug 03 12:12:24.316579 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 93/174] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:23 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:24.995998 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-87cc04f2-3cdf-46e1-a567-0034f7bc5acf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:24.999130 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-87cc04f2-3cdf-46e1-a567-0034f7bc5acf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:25.015324 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87cc04f2-3cdf-46e1-a567-0034f7bc5acf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:25.016835 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87cc04f2-3cdf-46e1-a567-0034f7bc5acf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:25.019092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87cc04f2-3cdf-46e1-a567-0034f7bc5acf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:25.020815 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87cc04f2-3cdf-46e1-a567-0034f7bc5acf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:25.029874 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:25.234417 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-87cc04f2-3cdf-46e1-a567-0034f7bc5acf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:25.245656 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-87cc04f2-3cdf-46e1-a567-0034f7bc5acf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:25.249649 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-87cc04f2-3cdf-46e1-a567-0034f7bc5acf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:25.251727 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-87cc04f2-3cdf-46e1-a567-0034f7bc5acf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.268086 Aug 03 12:12:25.268261 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 82/175] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:24 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:25.336413 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ceae8e57-1ee7-4bad-8a41-f360fe8ad184 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:25.337476 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ceae8e57-1ee7-4bad-8a41-f360fe8ad184 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:25.347979 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ceae8e57-1ee7-4bad-8a41-f360fe8ad184 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:25.348694 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ceae8e57-1ee7-4bad-8a41-f360fe8ad184 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:25.349937 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ceae8e57-1ee7-4bad-8a41-f360fe8ad184 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:25.350672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ceae8e57-1ee7-4bad-8a41-f360fe8ad184 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:25.364542 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7069369c-b0d6-4952-aed6-83c0912b0acf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:25.365558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7069369c-b0d6-4952-aed6-83c0912b0acf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:25.378237 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7069369c-b0d6-4952-aed6-83c0912b0acf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:25.379303 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7069369c-b0d6-4952-aed6-83c0912b0acf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:25.392138 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7069369c-b0d6-4952-aed6-83c0912b0acf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:25.393950 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7069369c-b0d6-4952-aed6-83c0912b0acf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:25.739429 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ceae8e57-1ee7-4bad-8a41-f360fe8ad184 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:25.758278 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ceae8e57-1ee7-4bad-8a41-f360fe8ad184 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1368 microversion: 2.1 time: 0.429291 Aug 03 12:12:25.766078 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 94/176] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:25 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1368 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:25.811710 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7069369c-b0d6-4952-aed6-83c0912b0acf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:25.838323 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7069369c-b0d6-4952-aed6-83c0912b0acf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.480694 Aug 03 12:12:25.845633 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 83/177] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:25 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:26.279017 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d1eb7772-fab5-41a7-85b6-465429098df8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:26.279965 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d1eb7772-fab5-41a7-85b6-465429098df8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:26.310816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d1eb7772-fab5-41a7-85b6-465429098df8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:26.311475 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d1eb7772-fab5-41a7-85b6-465429098df8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:26.314099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d1eb7772-fab5-41a7-85b6-465429098df8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:26.317317 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d1eb7772-fab5-41a7-85b6-465429098df8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:26.781145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e4dc43dd-4af8-463b-8abe-3a2b6b4c22a9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:26.782952 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e4dc43dd-4af8-463b-8abe-3a2b6b4c22a9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:26.791844 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e4dc43dd-4af8-463b-8abe-3a2b6b4c22a9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:26.792258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e4dc43dd-4af8-463b-8abe-3a2b6b4c22a9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:26.795285 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e4dc43dd-4af8-463b-8abe-3a2b6b4c22a9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:26.795828 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e4dc43dd-4af8-463b-8abe-3a2b6b4c22a9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:26.891322 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d1eb7772-fab5-41a7-85b6-465429098df8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:26.897677 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:26.908807 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d1eb7772-fab5-41a7-85b6-465429098df8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:26.915971 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d1eb7772-fab5-41a7-85b6-465429098df8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:26.917500 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d1eb7772-fab5-41a7-85b6-465429098df8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1407 microversion: 2.20 time: 0.644010 Aug 03 12:12:26.918637 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 95/178] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:26 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1407 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:12:26.923516 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8b88b083-8ff1-4c59-9140-8cbec70e0842 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:26.935853 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8b88b083-8ff1-4c59-9140-8cbec70e0842 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:26.951438 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8b88b083-8ff1-4c59-9140-8cbec70e0842 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:26.953999 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8b88b083-8ff1-4c59-9140-8cbec70e0842 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:26.956638 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8b88b083-8ff1-4c59-9140-8cbec70e0842 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:26.958474 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8b88b083-8ff1-4c59-9140-8cbec70e0842 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:27.008733 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e4dc43dd-4af8-463b-8abe-3a2b6b4c22a9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:27.017473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e4dc43dd-4af8-463b-8abe-3a2b6b4c22a9 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1558 microversion: 2.1 time: 0.240649 Aug 03 12:12:27.034746 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 84/179] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:26 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1558 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:27.041006 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5c4bec21-d921-4448-b9cc-2d38eb2f40e7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:27.041765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5c4bec21-d921-4448-b9cc-2d38eb2f40e7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:27.049548 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c4bec21-d921-4448-b9cc-2d38eb2f40e7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:27.050293 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c4bec21-d921-4448-b9cc-2d38eb2f40e7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:27.051317 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c4bec21-d921-4448-b9cc-2d38eb2f40e7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:27.051921 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c4bec21-d921-4448-b9cc-2d38eb2f40e7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:27.144351 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5c4bec21-d921-4448-b9cc-2d38eb2f40e7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107392 Aug 03 12:12:27.145173 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 85/180] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 3 12:12:27 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:12:27.549026 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8b88b083-8ff1-4c59-9140-8cbec70e0842 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:27.558159 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8b88b083-8ff1-4c59-9140-8cbec70e0842 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.638185 Aug 03 12:12:27.571027 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 96/181] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:26 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:27.962846 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-41738c42-004d-4037-a6b3-0ce53d444f4e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:27.962846 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-41738c42-004d-4037-a6b3-0ce53d444f4e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:27.979955 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-41738c42-004d-4037-a6b3-0ce53d444f4e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:27.982603 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-41738c42-004d-4037-a6b3-0ce53d444f4e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:27.987217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-41738c42-004d-4037-a6b3-0ce53d444f4e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:27.988043 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-41738c42-004d-4037-a6b3-0ce53d444f4e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:28.245838 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-41738c42-004d-4037-a6b3-0ce53d444f4e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:28.268657 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-41738c42-004d-4037-a6b3-0ce53d444f4e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:28.276066 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-41738c42-004d-4037-a6b3-0ce53d444f4e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:28.288460 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-41738c42-004d-4037-a6b3-0ce53d444f4e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1599 microversion: 2.20 time: 0.333557 Aug 03 12:12:28.291121 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 86/182] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:12:27 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1599 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:12:28.334846 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-dd7400e8-5146-4424-9104-d3f3961e26af tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:28.335618 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-dd7400e8-5146-4424-9104-d3f3961e26af tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:28.349562 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dd7400e8-5146-4424-9104-d3f3961e26af tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:28.350051 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dd7400e8-5146-4424-9104-d3f3961e26af tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:28.350881 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dd7400e8-5146-4424-9104-d3f3961e26af tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:28.358208 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dd7400e8-5146-4424-9104-d3f3961e26af tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:28.530496 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-dd7400e8-5146-4424-9104-d3f3961e26af tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.207064 Aug 03 12:12:28.532111 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 97/183] 10.222.0.17 () {60 vars in 1316 bytes} [Wed Aug 3 12:12:28 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:12:28.588129 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e92a2dde-3c04-41f0-9319-7e90c18f3476 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:28.590476 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e92a2dde-3c04-41f0-9319-7e90c18f3476 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:28.599538 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e92a2dde-3c04-41f0-9319-7e90c18f3476 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:28.599986 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e92a2dde-3c04-41f0-9319-7e90c18f3476 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:28.600765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e92a2dde-3c04-41f0-9319-7e90c18f3476 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:28.601195 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e92a2dde-3c04-41f0-9319-7e90c18f3476 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:28.810639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e92a2dde-3c04-41f0-9319-7e90c18f3476 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:28.820679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e92a2dde-3c04-41f0-9319-7e90c18f3476 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.236711 Aug 03 12:12:28.821780 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 87/184] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:28 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:29.241433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7b6037f9-8a59-435e-a479-f153fc36f922 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:29.247166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7b6037f9-8a59-435e-a479-f153fc36f922 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:29.263114 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b6037f9-8a59-435e-a479-f153fc36f922 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:29.264814 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b6037f9-8a59-435e-a479-f153fc36f922 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:29.266559 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b6037f9-8a59-435e-a479-f153fc36f922 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:29.268029 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7b6037f9-8a59-435e-a479-f153fc36f922 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:29.341059 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7b6037f9-8a59-435e-a479-f153fc36f922 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:12:29.528574 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7b6037f9-8a59-435e-a479-f153fc36f922 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "DELETE /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 204 len: 0 microversion: 2.1 time: 0.294642 Aug 03 12:12:29.530178 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 98/185] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:12:29 2022] DELETE /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:12:29.541119 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d7a27884-b22f-4799-8e42-23182ee43415 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:29.542535 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d7a27884-b22f-4799-8e42-23182ee43415 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:29.553442 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d7a27884-b22f-4799-8e42-23182ee43415 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:29.555723 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d7a27884-b22f-4799-8e42-23182ee43415 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:29.559128 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d7a27884-b22f-4799-8e42-23182ee43415 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:29.565814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d7a27884-b22f-4799-8e42-23182ee43415 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:29.846620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d5ca4ee6-05d2-496e-8441-68b0851b28e6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:29.846620 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d5ca4ee6-05d2-496e-8441-68b0851b28e6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:29.860932 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5ca4ee6-05d2-496e-8441-68b0851b28e6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:29.861390 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5ca4ee6-05d2-496e-8441-68b0851b28e6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:29.862240 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5ca4ee6-05d2-496e-8441-68b0851b28e6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:29.862727 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5ca4ee6-05d2-496e-8441-68b0851b28e6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:29.906063 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d7a27884-b22f-4799-8e42-23182ee43415 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:29.940419 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d7a27884-b22f-4799-8e42-23182ee43415 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1553 microversion: 2.1 time: 0.404565 Aug 03 12:12:29.963503 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 88/186] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:29 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1553 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:30.422594 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-6661a85d-8de2-469f-b27f-6ffc7098d5de req-133e24c5-0597-400a-aa87-5ab523c38541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fedea0ca-7f85-49dc-8459-160418843f05", "tag": "1d3fd848-19fd-4089-a319-b9a584a9c430"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:12:30.464852 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-6661a85d-8de2-469f-b27f-6ffc7098d5de req-133e24c5-0597-400a-aa87-5ab523c38541 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:30.468135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-6661a85d-8de2-469f-b27f-6ffc7098d5de req-133e24c5-0597-400a-aa87-5ab523c38541 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:30.483252 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d5ca4ee6-05d2-496e-8441-68b0851b28e6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:30.496596 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d5ca4ee6-05d2-496e-8441-68b0851b28e6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.654179 Aug 03 12:12:30.498564 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 99/187] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:29 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:30.518499 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-6661a85d-8de2-469f-b27f-6ffc7098d5de req-133e24c5-0597-400a-aa87-5ab523c38541 service nova] Creating event network-changed:1d3fd848-19fd-4089-a319-b9a584a9c430 for instance fedea0ca-7f85-49dc-8459-160418843f05 on hv-cinder-83602 Aug 03 12:12:30.524469 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-6661a85d-8de2-469f-b27f-6ffc7098d5de req-133e24c5-0597-400a-aa87-5ab523c38541 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119440 Aug 03 12:12:30.526372 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 89/188] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:12:30.971466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-22afc55a-98c5-4e2a-ab20-7576ee42d42e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:30.978875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-22afc55a-98c5-4e2a-ab20-7576ee42d42e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:30.995508 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-22afc55a-98c5-4e2a-ab20-7576ee42d42e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:30.997298 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-22afc55a-98c5-4e2a-ab20-7576ee42d42e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:30.998355 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-22afc55a-98c5-4e2a-ab20-7576ee42d42e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:31.001411 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-22afc55a-98c5-4e2a-ab20-7576ee42d42e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:31.536848 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e60d8656-47ab-4cc0-968f-75aeb119d86d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:31.547201 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e60d8656-47ab-4cc0-968f-75aeb119d86d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:31.555138 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-22afc55a-98c5-4e2a-ab20-7576ee42d42e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:31.567558 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-22afc55a-98c5-4e2a-ab20-7576ee42d42e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1553 microversion: 2.1 time: 0.601538 Aug 03 12:12:31.571040 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 100/189] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:30 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1553 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:31.586343 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e60d8656-47ab-4cc0-968f-75aeb119d86d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:31.590418 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e60d8656-47ab-4cc0-968f-75aeb119d86d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:31.591600 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e60d8656-47ab-4cc0-968f-75aeb119d86d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:31.594424 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e60d8656-47ab-4cc0-968f-75aeb119d86d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:32.350822 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e60d8656-47ab-4cc0-968f-75aeb119d86d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:32.381432 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e60d8656-47ab-4cc0-968f-75aeb119d86d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.863743 Aug 03 12:12:32.384868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 90/190] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:31 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:32.593940 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-003a4dd6-0d92-47be-beeb-27226c02cdca tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:32.594863 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-003a4dd6-0d92-47be-beeb-27226c02cdca tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:32.607837 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-003a4dd6-0d92-47be-beeb-27226c02cdca tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:32.609785 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-003a4dd6-0d92-47be-beeb-27226c02cdca tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:32.612687 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-003a4dd6-0d92-47be-beeb-27226c02cdca tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:32.618770 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-df84bc0d-80f9-464c-a8ef-f4a6a4baab75 req-e18676c4-ba50-4edd-a649-332bd43d0eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4afb38cd-ec9c-4509-b7c8-91b170684ec5", "tag": "8f2969cf-b117-4fef-a2f6-5587992eefda"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:12:32.631922 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-003a4dd6-0d92-47be-beeb-27226c02cdca tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:32.650626 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-df84bc0d-80f9-464c-a8ef-f4a6a4baab75 req-e18676c4-ba50-4edd-a649-332bd43d0eeb service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:32.667782 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-df84bc0d-80f9-464c-a8ef-f4a6a4baab75 req-e18676c4-ba50-4edd-a649-332bd43d0eeb service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:32.706590 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-df84bc0d-80f9-464c-a8ef-f4a6a4baab75 req-e18676c4-ba50-4edd-a649-332bd43d0eeb service nova] Creating event network-changed:8f2969cf-b117-4fef-a2f6-5587992eefda for instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 on hv-cinder-83602 Aug 03 12:12:32.731085 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-df84bc0d-80f9-464c-a8ef-f4a6a4baab75 req-e18676c4-ba50-4edd-a649-332bd43d0eeb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106287 Aug 03 12:12:32.733912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 91/191] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:12:33.413181 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e0583b4f-6965-417f-8157-4ce2983ae87e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:33.414044 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e0583b4f-6965-417f-8157-4ce2983ae87e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:33.426896 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e0583b4f-6965-417f-8157-4ce2983ae87e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:33.427354 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e0583b4f-6965-417f-8157-4ce2983ae87e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:33.428166 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e0583b4f-6965-417f-8157-4ce2983ae87e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:33.428612 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e0583b4f-6965-417f-8157-4ce2983ae87e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:33.587866 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-003a4dd6-0d92-47be-beeb-27226c02cdca tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:33.598855 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-003a4dd6-0d92-47be-beeb-27226c02cdca tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1553 microversion: 2.1 time: 1.010140 Aug 03 12:12:33.603916 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 101/192] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:32 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1553 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:34.040591 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e0583b4f-6965-417f-8157-4ce2983ae87e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:34.052144 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e0583b4f-6965-417f-8157-4ce2983ae87e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.649698 Aug 03 12:12:34.053130 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 92/193] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:33 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:34.516453 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-bb742e72-45cc-48d2-bb88-e30b58f75719 req-2989366b-859b-4e8e-b893-05698e45fbdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edbf4859-738e-4993-8a7a-006a27c69279", "name": "network-vif-deleted", "tag": "0c84946e-8f0e-48e4-a558-b8ad74fc5016"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:12:34.561673 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-bb742e72-45cc-48d2-bb88-e30b58f75719 req-2989366b-859b-4e8e-b893-05698e45fbdc service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:34.562611 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-bb742e72-45cc-48d2-bb88-e30b58f75719 req-2989366b-859b-4e8e-b893-05698e45fbdc service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:34.621437 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-90687178-f75a-4806-b146-63a531b4ca4e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:34.622063 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-90687178-f75a-4806-b146-63a531b4ca4e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:34.641026 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-90687178-f75a-4806-b146-63a531b4ca4e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:34.641601 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-bb742e72-45cc-48d2-bb88-e30b58f75719 req-2989366b-859b-4e8e-b893-05698e45fbdc service nova] Creating event network-vif-deleted:0c84946e-8f0e-48e4-a558-b8ad74fc5016 for instance edbf4859-738e-4993-8a7a-006a27c69279 on hv-cinder-83602 Aug 03 12:12:34.644506 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-90687178-f75a-4806-b146-63a531b4ca4e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:34.645360 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-90687178-f75a-4806-b146-63a531b4ca4e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:34.645803 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-90687178-f75a-4806-b146-63a531b4ca4e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:34.659502 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-bb742e72-45cc-48d2-bb88-e30b58f75719 req-2989366b-859b-4e8e-b893-05698e45fbdc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151417 Aug 03 12:12:34.661845 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 102/194] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:12:34.778743 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-90687178-f75a-4806-b146-63a531b4ca4e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0305cbb5a9491c85a89d0b40cb821a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7a3700a24217bcd8474d46717c92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:34.790351 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-90687178-f75a-4806-b146-63a531b4ca4e tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 200 len: 1345 microversion: 2.1 time: 0.172955 Aug 03 12:12:34.803432 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 93/195] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:34 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 1345 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:35.108669 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bf6dce15-25fc-4c9e-ac39-817ee1d7de9b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:35.109917 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bf6dce15-25fc-4c9e-ac39-817ee1d7de9b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:35.121977 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bf6dce15-25fc-4c9e-ac39-817ee1d7de9b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:35.122781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bf6dce15-25fc-4c9e-ac39-817ee1d7de9b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:35.124376 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bf6dce15-25fc-4c9e-ac39-817ee1d7de9b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:35.125434 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bf6dce15-25fc-4c9e-ac39-817ee1d7de9b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:35.370406 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bf6dce15-25fc-4c9e-ac39-817ee1d7de9b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:35.397379 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bf6dce15-25fc-4c9e-ac39-817ee1d7de9b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.294560 Aug 03 12:12:35.398039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 103/196] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:35 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:12:35.813433 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cd4df0ca-d57a-4739-99a2-f2856a4d7648 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:35.814409 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-cd4df0ca-d57a-4739-99a2-f2856a4d7648 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:35.822226 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd4df0ca-d57a-4739-99a2-f2856a4d7648 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:35.822702 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd4df0ca-d57a-4739-99a2-f2856a4d7648 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:35.829873 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd4df0ca-d57a-4739-99a2-f2856a4d7648 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:35.831671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd4df0ca-d57a-4739-99a2-f2856a4d7648 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:35.864838 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-cd4df0ca-d57a-4739-99a2-f2856a4d7648 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] HTTP exception thrown: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cd4df0ca-d57a-4739-99a2-f2856a4d7648 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Request method failure captured: Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 HTTP/1.1 Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXq19kgFQvFHJIoIge6otjPpQ6fyC-xwOz94y19ztPtXFQejPhWZVAYhuRwNHqZeT3_J_KfYLo4suTcxLGymk5ZxGSX39SYS6DO14Sdlto50WlhnLe3ZHOM6eFmhdppQq26Ply4UL_v8TVyZ1pgBmqSrZB9YKXuQfQEP_rv1u0buf8 Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 76ff7a3700a24217bcd8474d46717c92 Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-DeleteServersTestJSON-1059603091 Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:12:35.877671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:12:35.879292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76ff7a3700a24217bcd8474d46717c92", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76ff7a3700a24217bcd8474d46717c92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76ff7a3700a24217bcd8474d46717c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76ff7a3700a24217bcd8474d46717c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:12:35.879292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-DeleteServersTestJSON-1059603091 Aug 03 12:12:35.879292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 76ff7a3700a24217bcd8474d46717c92 Aug 03 12:12:35.879292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-DeleteServersTestJSON-1059603091 Aug 03 12:12:35.879292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-DeleteServersTestJSON-1059603091-project Aug 03 12:12:35.879292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:12:35.879292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:12:35.879292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 9e0305cbb5a9491c85a89d0b40cb821a Aug 03 12:12:35.879292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-DeleteServersTestJSON-1059603091-project Aug 03 12:12:35.879292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:12:35.879292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:35.879292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'edbf4859-738e-4993-8a7a-006a27c69279'} Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:12:35.880096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:35.881236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:12:35.882163 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cd4df0ca-d57a-4739-99a2-f2856a4d7648 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Returning 404 to user: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:12:35.882163 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-cd4df0ca-d57a-4739-99a2-f2856a4d7648 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 404 len: 111 microversion: 2.1 time: 0.070944 Aug 03 12:12:35.882163 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 94/197] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:35 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:12:36.069042 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-59c774af-0983-4a51-baa9-52c9e5d9f3c8 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:36.071262 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-59c774af-0983-4a51-baa9-52c9e5d9f3c8 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:36.078955 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-59c774af-0983-4a51-baa9-52c9e5d9f3c8 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:36.080299 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-59c774af-0983-4a51-baa9-52c9e5d9f3c8 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:36.081633 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-59c774af-0983-4a51-baa9-52c9e5d9f3c8 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:36.083268 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-59c774af-0983-4a51-baa9-52c9e5d9f3c8 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:36.112060 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-59c774af-0983-4a51-baa9-52c9e5d9f3c8 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] HTTP exception thrown: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-59c774af-0983-4a51-baa9-52c9e5d9f3c8 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Request method failure captured: Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279/os-volume_attachments HTTP/1.1 Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXq19kgFQvFHJIoIge6otjPpQ6fyC-xwOz94y19ztPtXFQejPhWZVAYhuRwNHqZeT3_J_KfYLo4suTcxLGymk5ZxGSX39SYS6DO14Sdlto50WlhnLe3ZHOM6eFmhdppQq26Ply4UL_v8TVyZ1pgBmqSrZB9YKXuQfQEP_rv1u0buf8 Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 76ff7a3700a24217bcd8474d46717c92 Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-DeleteServersTestJSON-1059603091 Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:12:36.127632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:12:36.129561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76ff7a3700a24217bcd8474d46717c92", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76ff7a3700a24217bcd8474d46717c92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76ff7a3700a24217bcd8474d46717c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76ff7a3700a24217bcd8474d46717c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:12:36.129561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-DeleteServersTestJSON-1059603091 Aug 03 12:12:36.129561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 76ff7a3700a24217bcd8474d46717c92 Aug 03 12:12:36.129561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-DeleteServersTestJSON-1059603091 Aug 03 12:12:36.129561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-DeleteServersTestJSON-1059603091-project Aug 03 12:12:36.129561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:12:36.129561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:12:36.129561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 9e0305cbb5a9491c85a89d0b40cb821a Aug 03 12:12:36.129561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-DeleteServersTestJSON-1059603091-project Aug 03 12:12:36.129561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:12:36.129561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:36.129561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'server_id': 'edbf4859-738e-4993-8a7a-006a27c69279'} Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:12:36.130809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:36.132833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:12:36.143358 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-59c774af-0983-4a51-baa9-52c9e5d9f3c8 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Returning 404 to user: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:12:36.145148 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-59c774af-0983-4a51-baa9-52c9e5d9f3c8 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.080299 Aug 03 12:12:36.145994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 104/198] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:12:36 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279/os-volume_attachments => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:12:36.432067 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1e3d913d-9179-4405-9b70-bc68914bbba0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:36.433400 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1e3d913d-9179-4405-9b70-bc68914bbba0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:36.446707 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1e3d913d-9179-4405-9b70-bc68914bbba0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:36.447685 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1e3d913d-9179-4405-9b70-bc68914bbba0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:36.449499 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1e3d913d-9179-4405-9b70-bc68914bbba0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:36.450338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1e3d913d-9179-4405-9b70-bc68914bbba0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:36.888288 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1e3d913d-9179-4405-9b70-bc68914bbba0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:36.937665 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1e3d913d-9179-4405-9b70-bc68914bbba0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.514807 Aug 03 12:12:36.938821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 95/199] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:36 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:37.592982 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3f24b664-9f74-4bbd-9a1b-d59b18b63395 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:37.594768 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3f24b664-9f74-4bbd-9a1b-d59b18b63395 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:37.605721 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3f24b664-9f74-4bbd-9a1b-d59b18b63395 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:37.606493 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3f24b664-9f74-4bbd-9a1b-d59b18b63395 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:37.608008 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3f24b664-9f74-4bbd-9a1b-d59b18b63395 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:37.608862 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3f24b664-9f74-4bbd-9a1b-d59b18b63395 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:37.636834 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-3f24b664-9f74-4bbd-9a1b-d59b18b63395 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] HTTP exception thrown: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3f24b664-9f74-4bbd-9a1b-d59b18b63395 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Request method failure captured: Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: DELETE /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 HTTP/1.1 Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXq19kgFQvFHJIoIge6otjPpQ6fyC-xwOz94y19ztPtXFQejPhWZVAYhuRwNHqZeT3_J_KfYLo4suTcxLGymk5ZxGSX39SYS6DO14Sdlto50WlhnLe3ZHOM6eFmhdppQq26Ply4UL_v8TVyZ1pgBmqSrZB9YKXuQfQEP_rv1u0buf8 Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 76ff7a3700a24217bcd8474d46717c92 Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-DeleteServersTestJSON-1059603091 Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:12:37.640576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:12:37.643445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76ff7a3700a24217bcd8474d46717c92", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76ff7a3700a24217bcd8474d46717c92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76ff7a3700a24217bcd8474d46717c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76ff7a3700a24217bcd8474d46717c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:12:37.643445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-DeleteServersTestJSON-1059603091 Aug 03 12:12:37.643445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 76ff7a3700a24217bcd8474d46717c92 Aug 03 12:12:37.643445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-DeleteServersTestJSON-1059603091 Aug 03 12:12:37.643445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-DeleteServersTestJSON-1059603091-project Aug 03 12:12:37.643445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:12:37.643445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:12:37.643445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 9e0305cbb5a9491c85a89d0b40cb821a Aug 03 12:12:37.643445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-DeleteServersTestJSON-1059603091-project Aug 03 12:12:37.643445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:12:37.643445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:37.643445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'edbf4859-738e-4993-8a7a-006a27c69279'} Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:12:37.644709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:37.646951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:12:37.650128 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3f24b664-9f74-4bbd-9a1b-d59b18b63395 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Returning 404 to user: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:12:37.651659 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3f24b664-9f74-4bbd-9a1b-d59b18b63395 tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "DELETE /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 404 len: 111 microversion: 2.1 time: 0.064720 Aug 03 12:12:37.652861 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 105/200] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:12:37 2022] DELETE /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:12:37.664083 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d652ccb0-6dcc-4d1f-877f-e77ac16c428a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:37.664699 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d652ccb0-6dcc-4d1f-877f-e77ac16c428a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] [instance: edbf4859-738e-4993-8a7a-006a27c69279] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:37.671653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d652ccb0-6dcc-4d1f-877f-e77ac16c428a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:37.672298 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d652ccb0-6dcc-4d1f-877f-e77ac16c428a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:37.673278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d652ccb0-6dcc-4d1f-877f-e77ac16c428a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:37.673892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d652ccb0-6dcc-4d1f-877f-e77ac16c428a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:37.693202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-d652ccb0-6dcc-4d1f-877f-e77ac16c428a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] HTTP exception thrown: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d652ccb0-6dcc-4d1f-877f-e77ac16c428a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Request method failure captured: Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 HTTP/1.1 Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXq19kgFQvFHJIoIge6otjPpQ6fyC-xwOz94y19ztPtXFQejPhWZVAYhuRwNHqZeT3_J_KfYLo4suTcxLGymk5ZxGSX39SYS6DO14Sdlto50WlhnLe3ZHOM6eFmhdppQq26Ply4UL_v8TVyZ1pgBmqSrZB9YKXuQfQEP_rv1u0buf8 Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 76ff7a3700a24217bcd8474d46717c92 Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-DeleteServersTestJSON-1059603091 Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:12:37.695051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:12:37.704062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_76ff7a3700a24217bcd8474d46717c92", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/76ff7a3700a24217bcd8474d46717c92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76ff7a3700a24217bcd8474d46717c92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/76ff7a3700a24217bcd8474d46717c92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:12:37.704062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-DeleteServersTestJSON-1059603091 Aug 03 12:12:37.704062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 76ff7a3700a24217bcd8474d46717c92 Aug 03 12:12:37.704062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-DeleteServersTestJSON-1059603091 Aug 03 12:12:37.704062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-DeleteServersTestJSON-1059603091-project Aug 03 12:12:37.704062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:12:37.704062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:12:37.704062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 9e0305cbb5a9491c85a89d0b40cb821a Aug 03 12:12:37.704062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-DeleteServersTestJSON-1059603091-project Aug 03 12:12:37.704062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:12:37.704062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:37.704062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'edbf4859-738e-4993-8a7a-006a27c69279'} Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:12:37.705706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. Aug 03 12:12:37.707821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:12:37.709412 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d652ccb0-6dcc-4d1f-877f-e77ac16c428a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] Returning 404 to user: Instance edbf4859-738e-4993-8a7a-006a27c69279 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:12:37.709412 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d652ccb0-6dcc-4d1f-877f-e77ac16c428a tempest-DeleteServersTestJSON-1059603091 tempest-DeleteServersTestJSON-1059603091-project] 10.222.0.17 "GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279" status: 404 len: 111 microversion: 2.1 time: 0.037755 Aug 03 12:12:37.709412 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 96/201] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:37 2022] GET /compute/v2.1/servers/edbf4859-738e-4993-8a7a-006a27c69279 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 12:12:37.960922 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-04a6260a-4b9b-4be1-a9b4-4be1e4569011 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:37.962413 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-04a6260a-4b9b-4be1-a9b4-4be1e4569011 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:37.970168 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-04a6260a-4b9b-4be1-a9b4-4be1e4569011 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:37.970936 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-04a6260a-4b9b-4be1-a9b4-4be1e4569011 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:37.972385 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-04a6260a-4b9b-4be1-a9b4-4be1e4569011 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:37.973059 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-04a6260a-4b9b-4be1-a9b4-4be1e4569011 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:38.604144 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-04a6260a-4b9b-4be1-a9b4-4be1e4569011 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:38.617156 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-04a6260a-4b9b-4be1-a9b4-4be1e4569011 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.660660 Aug 03 12:12:38.618683 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 106/202] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:37 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:39.639867 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2809bcac-4c79-4347-9cdf-4d76a2bcb833 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:39.641194 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2809bcac-4c79-4347-9cdf-4d76a2bcb833 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:39.648277 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2809bcac-4c79-4347-9cdf-4d76a2bcb833 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:39.655000 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2809bcac-4c79-4347-9cdf-4d76a2bcb833 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:39.656974 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2809bcac-4c79-4347-9cdf-4d76a2bcb833 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:39.657862 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2809bcac-4c79-4347-9cdf-4d76a2bcb833 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:39.903907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2809bcac-4c79-4347-9cdf-4d76a2bcb833 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:39.911800 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2809bcac-4c79-4347-9cdf-4d76a2bcb833 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.276131 Aug 03 12:12:39.912981 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 97/203] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:39 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:40.936832 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6e3e6f71-67d5-4190-bf47-7d2e6f3ebd39 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:40.937455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6e3e6f71-67d5-4190-bf47-7d2e6f3ebd39 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:40.941558 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:40.955046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6e3e6f71-67d5-4190-bf47-7d2e6f3ebd39 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:40.955938 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6e3e6f71-67d5-4190-bf47-7d2e6f3ebd39 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:40.957979 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6e3e6f71-67d5-4190-bf47-7d2e6f3ebd39 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:40.961397 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6e3e6f71-67d5-4190-bf47-7d2e6f3ebd39 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:41.235088 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6e3e6f71-67d5-4190-bf47-7d2e6f3ebd39 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:41.247119 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6e3e6f71-67d5-4190-bf47-7d2e6f3ebd39 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.314256 Aug 03 12:12:41.248457 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 107/204] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:40 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:42.271919 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-655baf08-26fe-40dc-bb3c-db032b71c28a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:42.273324 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-655baf08-26fe-40dc-bb3c-db032b71c28a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:42.281806 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=72 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:42.285118 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-655baf08-26fe-40dc-bb3c-db032b71c28a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:42.285929 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-655baf08-26fe-40dc-bb3c-db032b71c28a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:42.287618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-655baf08-26fe-40dc-bb3c-db032b71c28a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:42.288906 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-655baf08-26fe-40dc-bb3c-db032b71c28a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:42.799377 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-655baf08-26fe-40dc-bb3c-db032b71c28a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:42.809171 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-655baf08-26fe-40dc-bb3c-db032b71c28a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.541598 Aug 03 12:12:42.819788 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 98/205] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:42 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:43.836247 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1ce774cd-a650-4453-8a8c-5ca8c5702aa3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:43.837678 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1ce774cd-a650-4453-8a8c-5ca8c5702aa3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:43.847912 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ce774cd-a650-4453-8a8c-5ca8c5702aa3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:43.849538 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ce774cd-a650-4453-8a8c-5ca8c5702aa3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:43.851639 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ce774cd-a650-4453-8a8c-5ca8c5702aa3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:43.852346 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ce774cd-a650-4453-8a8c-5ca8c5702aa3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:44.068557 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1ce774cd-a650-4453-8a8c-5ca8c5702aa3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:44.078923 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1ce774cd-a650-4453-8a8c-5ca8c5702aa3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.249476 Aug 03 12:12:44.079840 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 108/206] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:43 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:45.101605 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0aa14c63-ac15-4c16-99b1-b8cc9cad4d4d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:45.102216 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-0aa14c63-ac15-4c16-99b1-b8cc9cad4d4d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:45.110969 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0aa14c63-ac15-4c16-99b1-b8cc9cad4d4d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:45.112021 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0aa14c63-ac15-4c16-99b1-b8cc9cad4d4d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:45.112711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0aa14c63-ac15-4c16-99b1-b8cc9cad4d4d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:45.113636 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0aa14c63-ac15-4c16-99b1-b8cc9cad4d4d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:45.342427 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-0aa14c63-ac15-4c16-99b1-b8cc9cad4d4d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:45.351328 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-0aa14c63-ac15-4c16-99b1-b8cc9cad4d4d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.253481 Aug 03 12:12:45.354933 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 99/207] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:45 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:46.381514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7090332f-6534-4530-8a46-bf851015d86e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:46.383462 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7090332f-6534-4530-8a46-bf851015d86e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:46.394881 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7090332f-6534-4530-8a46-bf851015d86e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:46.396895 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7090332f-6534-4530-8a46-bf851015d86e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:46.398806 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7090332f-6534-4530-8a46-bf851015d86e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:46.400756 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7090332f-6534-4530-8a46-bf851015d86e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:47.089880 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7090332f-6534-4530-8a46-bf851015d86e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:47.122198 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7090332f-6534-4530-8a46-bf851015d86e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.747241 Aug 03 12:12:47.123228 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 109/208] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:46 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:48.169442 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-71e1cd32-d660-4eb3-bb36-335ba89a1189 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:48.170205 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-71e1cd32-d660-4eb3-bb36-335ba89a1189 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:48.190731 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71e1cd32-d660-4eb3-bb36-335ba89a1189 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:48.191191 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71e1cd32-d660-4eb3-bb36-335ba89a1189 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:48.191995 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71e1cd32-d660-4eb3-bb36-335ba89a1189 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:48.192440 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71e1cd32-d660-4eb3-bb36-335ba89a1189 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:48.502476 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-71e1cd32-d660-4eb3-bb36-335ba89a1189 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:48.516696 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-71e1cd32-d660-4eb3-bb36-335ba89a1189 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.353055 Aug 03 12:12:48.518340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 100/209] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:48 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:49.545384 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-947b8bdd-5a47-46a3-9b72-8f5e0134db65 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:49.547006 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-947b8bdd-5a47-46a3-9b72-8f5e0134db65 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:49.585719 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-947b8bdd-5a47-46a3-9b72-8f5e0134db65 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:49.586167 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-947b8bdd-5a47-46a3-9b72-8f5e0134db65 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:49.587797 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-947b8bdd-5a47-46a3-9b72-8f5e0134db65 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:49.588259 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-947b8bdd-5a47-46a3-9b72-8f5e0134db65 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:49.894087 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-947b8bdd-5a47-46a3-9b72-8f5e0134db65 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:49.914919 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-947b8bdd-5a47-46a3-9b72-8f5e0134db65 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.370685 Aug 03 12:12:49.915650 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 110/210] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:49 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:50.969285 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-25e16572-6cbd-4585-9dc6-7be365608e2e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:50.979180 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-25e16572-6cbd-4585-9dc6-7be365608e2e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:50.994109 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-25e16572-6cbd-4585-9dc6-7be365608e2e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:50.995873 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-25e16572-6cbd-4585-9dc6-7be365608e2e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:50.997240 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-25e16572-6cbd-4585-9dc6-7be365608e2e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:50.998404 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-25e16572-6cbd-4585-9dc6-7be365608e2e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:51.295357 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-25e16572-6cbd-4585-9dc6-7be365608e2e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:51.305290 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=100 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:51.311226 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-25e16572-6cbd-4585-9dc6-7be365608e2e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.360011 Aug 03 12:12:51.337980 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 101/211] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:50 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:52.342518 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4b62b47f-d299-4e8d-ad60-14aabea635a1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:52.346791 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4b62b47f-d299-4e8d-ad60-14aabea635a1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:52.359654 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b62b47f-d299-4e8d-ad60-14aabea635a1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:52.360793 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b62b47f-d299-4e8d-ad60-14aabea635a1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:52.362397 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b62b47f-d299-4e8d-ad60-14aabea635a1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:52.363547 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b62b47f-d299-4e8d-ad60-14aabea635a1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:52.707631 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4b62b47f-d299-4e8d-ad60-14aabea635a1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:52.724894 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4b62b47f-d299-4e8d-ad60-14aabea635a1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.390017 Aug 03 12:12:52.739154 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 111/212] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:52 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:52.792480 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6179d6cd-66b9-4521-9624-cc1a2b1e4bd5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Action: 'create', calling method: .version_select at 0x7f14dc18ddc0>, body: {"keypair": {"name": "tempest-keypair-974631001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1Z//Mk4gs/cqAB7T/cvS+9LGdkDa1TpjUX8BYovKwV8dCDKi8qS8PSnKvxCU1lKCSv8N36DOEmWrBLG+G84PFo7R/rx7ElfQwsGfSiEt+/6b+QYZk0codj44eRPjPBRg=="}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:12:52.816049 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-6179d6cd-66b9-4521-9624-cc1a2b1e4bd5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Getting quotas for project 8bf1655c29144bb2a7d925a5a5b22bdb. Resources: {'key_pairs'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:12:52.826078 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-6179d6cd-66b9-4521-9624-cc1a2b1e4bd5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Getting quotas for user 023c699e0cac426f8e7229ebbb7727b7 and project 8bf1655c29144bb2a7d925a5a5b22bdb. Resources: {'key_pairs'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:12:52.861209 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6179d6cd-66b9-4521-9624-cc1a2b1e4bd5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.332888 Aug 03 12:12:52.862578 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 102/213] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 3 12:12:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:12:53.755826 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2c134388-90f5-4832-84cd-ae00b967fbcd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:53.756452 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2c134388-90f5-4832-84cd-ae00b967fbcd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:53.772651 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c134388-90f5-4832-84cd-ae00b967fbcd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:53.773143 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c134388-90f5-4832-84cd-ae00b967fbcd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:53.773897 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c134388-90f5-4832-84cd-ae00b967fbcd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:53.774375 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c134388-90f5-4832-84cd-ae00b967fbcd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:54.377290 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2c134388-90f5-4832-84cd-ae00b967fbcd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:54.390167 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2c134388-90f5-4832-84cd-ae00b967fbcd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.638196 Aug 03 12:12:54.413652 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 112/214] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:53 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:55.423194 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-9045b4b4-39e7-43af-b6d9-1a38780aa6de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:55.424558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-9045b4b4-39e7-43af-b6d9-1a38780aa6de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:55.450000 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9045b4b4-39e7-43af-b6d9-1a38780aa6de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:55.450496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9045b4b4-39e7-43af-b6d9-1a38780aa6de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:55.451309 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9045b4b4-39e7-43af-b6d9-1a38780aa6de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:55.451934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9045b4b4-39e7-43af-b6d9-1a38780aa6de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:55.530210 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2054368738", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b75cfbf7-4349-4c9b-8bc5-90bc1a193e08"}], "security_groups": [{"name": "tempest-securitygroup--1604852141"}], "key_name": "tempest-keypair-974631001", "user_data": "}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:12:55.724965 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] validate_networks() for [('b75cfbf7-4349-4c9b-8bc5-90bc1a193e08', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:12:55.725316 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-9045b4b4-39e7-43af-b6d9-1a38780aa6de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:55.737133 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-9045b4b4-39e7-43af-b6d9-1a38780aa6de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.318326 Aug 03 12:12:55.740829 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 103/215] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:55 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:56.471278 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:12:56.471706 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:12:56.472180 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:12:56.472593 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:12:56.473008 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:12:56.501447 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:56.501899 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:56.502752 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:56.503194 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:56.517526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:12:56.542309 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Getting quotas for project 8bf1655c29144bb2a7d925a5a5b22bdb. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:12:56.553361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Getting quotas for user 023c699e0cac426f8e7229ebbb7727b7 and project 8bf1655c29144bb2a7d925a5a5b22bdb. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:12:56.592480 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:12:56.598021 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:12:56.702368 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-171008ab-c19e-4181-8404-bc79c01796da tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.176462 Aug 03 12:12:56.703102 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 113/216] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:12:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:12:56.719044 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-8b245f84-a811-43dc-a715-1c9308306449 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:56.722523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-8b245f84-a811-43dc-a715-1c9308306449 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:56.778208 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2aec5a54-ce66-45a1-904e-52e05d368d59 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:56.778881 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2aec5a54-ce66-45a1-904e-52e05d368d59 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:56.789526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2aec5a54-ce66-45a1-904e-52e05d368d59 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:56.790550 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2aec5a54-ce66-45a1-904e-52e05d368d59 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:56.806863 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2aec5a54-ce66-45a1-904e-52e05d368d59 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:56.806863 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2aec5a54-ce66-45a1-904e-52e05d368d59 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:56.829333 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-8b245f84-a811-43dc-a715-1c9308306449 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:56.839282 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-8b245f84-a811-43dc-a715-1c9308306449 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1237 microversion: 2.1 time: 0.124985 Aug 03 12:12:56.840195 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 104/217] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:56 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1237 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:57.048228 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2aec5a54-ce66-45a1-904e-52e05d368d59 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:57.070740 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2aec5a54-ce66-45a1-904e-52e05d368d59 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.292096 Aug 03 12:12:57.070740 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 114/218] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:56 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:57.865510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-9a72402b-5a10-40a1-a47f-930678321667 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:57.866128 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-9a72402b-5a10-40a1-a47f-930678321667 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:57.882816 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9a72402b-5a10-40a1-a47f-930678321667 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:57.883274 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9a72402b-5a10-40a1-a47f-930678321667 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:57.884168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9a72402b-5a10-40a1-a47f-930678321667 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:57.884601 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9a72402b-5a10-40a1-a47f-930678321667 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:57.967817 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-9a72402b-5a10-40a1-a47f-930678321667 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:57.976497 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-9a72402b-5a10-40a1-a47f-930678321667 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1289 microversion: 2.1 time: 0.114821 Aug 03 12:12:57.977270 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 105/219] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:57 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1289 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:58.090347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-58cb5012-8b89-4ed5-a16e-ad39fc3d9548 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:58.091548 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-58cb5012-8b89-4ed5-a16e-ad39fc3d9548 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:58.098979 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-58cb5012-8b89-4ed5-a16e-ad39fc3d9548 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:58.099439 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-58cb5012-8b89-4ed5-a16e-ad39fc3d9548 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:58.100241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-58cb5012-8b89-4ed5-a16e-ad39fc3d9548 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:58.100920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-58cb5012-8b89-4ed5-a16e-ad39fc3d9548 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:58.268881 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-58cb5012-8b89-4ed5-a16e-ad39fc3d9548 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:58.277139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-58cb5012-8b89-4ed5-a16e-ad39fc3d9548 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.191495 Aug 03 12:12:58.277722 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 115/220] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:58 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:59.009409 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-efb9634a-098e-4a8b-94da-497447875c9c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:59.010129 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-efb9634a-098e-4a8b-94da-497447875c9c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:59.017701 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-efb9634a-098e-4a8b-94da-497447875c9c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:59.018405 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-efb9634a-098e-4a8b-94da-497447875c9c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:59.019637 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-efb9634a-098e-4a8b-94da-497447875c9c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:59.020219 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-efb9634a-098e-4a8b-94da-497447875c9c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:59.090112 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-efb9634a-098e-4a8b-94da-497447875c9c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:59.099475 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-efb9634a-098e-4a8b-94da-497447875c9c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1297 microversion: 2.1 time: 0.093922 Aug 03 12:12:59.100401 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 106/221] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:59 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:12:59.298283 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1ef7e02c-0ff6-4fbc-8e9d-34b54117cf3c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:12:59.298914 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1ef7e02c-0ff6-4fbc-8e9d-34b54117cf3c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:12:59.305101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ef7e02c-0ff6-4fbc-8e9d-34b54117cf3c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:59.305553 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ef7e02c-0ff6-4fbc-8e9d-34b54117cf3c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:59.306314 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ef7e02c-0ff6-4fbc-8e9d-34b54117cf3c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:12:59.306779 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ef7e02c-0ff6-4fbc-8e9d-34b54117cf3c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:12:59.445264 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1ef7e02c-0ff6-4fbc-8e9d-34b54117cf3c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:12:59.453556 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1ef7e02c-0ff6-4fbc-8e9d-34b54117cf3c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.159005 Aug 03 12:12:59.454144 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 116/222] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:12:59 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:00.121903 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f6c377e9-b9c7-4863-9ac0-7e87ee5ed659 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:00.122493 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f6c377e9-b9c7-4863-9ac0-7e87ee5ed659 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:00.129026 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f6c377e9-b9c7-4863-9ac0-7e87ee5ed659 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:00.129476 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f6c377e9-b9c7-4863-9ac0-7e87ee5ed659 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:00.130235 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f6c377e9-b9c7-4863-9ac0-7e87ee5ed659 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:00.130705 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f6c377e9-b9c7-4863-9ac0-7e87ee5ed659 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:00.190635 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f6c377e9-b9c7-4863-9ac0-7e87ee5ed659 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:00.198191 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f6c377e9-b9c7-4863-9ac0-7e87ee5ed659 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1297 microversion: 2.1 time: 0.080180 Aug 03 12:13:00.198803 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 107/223] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:00 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1297 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:00.475665 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a93846c4-a749-40a6-a90d-f1f364df32b1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:00.476724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a93846c4-a749-40a6-a90d-f1f364df32b1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:00.483018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a93846c4-a749-40a6-a90d-f1f364df32b1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:00.483464 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a93846c4-a749-40a6-a90d-f1f364df32b1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:00.484237 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a93846c4-a749-40a6-a90d-f1f364df32b1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:00.484664 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a93846c4-a749-40a6-a90d-f1f364df32b1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:00.617898 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a93846c4-a749-40a6-a90d-f1f364df32b1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:00.625502 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a93846c4-a749-40a6-a90d-f1f364df32b1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.153659 Aug 03 12:13:00.626073 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 117/224] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:00 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:13:01.219996 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-752e5a3a-d103-4251-ac99-1f877fdf7275 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:01.220640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-752e5a3a-d103-4251-ac99-1f877fdf7275 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:01.228041 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-752e5a3a-d103-4251-ac99-1f877fdf7275 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:01.228482 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-752e5a3a-d103-4251-ac99-1f877fdf7275 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:01.229264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-752e5a3a-d103-4251-ac99-1f877fdf7275 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:01.229698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-752e5a3a-d103-4251-ac99-1f877fdf7275 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:01.542346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-752e5a3a-d103-4251-ac99-1f877fdf7275 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:01.551649 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-752e5a3a-d103-4251-ac99-1f877fdf7275 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1295 microversion: 2.1 time: 0.335448 Aug 03 12:13:01.552245 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 108/225] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:01 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1295 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:01.648719 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b343dea4-4de9-4990-b29f-d674ad4a144e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:01.649561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b343dea4-4de9-4990-b29f-d674ad4a144e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:01.656051 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b343dea4-4de9-4990-b29f-d674ad4a144e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:01.656595 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b343dea4-4de9-4990-b29f-d674ad4a144e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:01.657449 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b343dea4-4de9-4990-b29f-d674ad4a144e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:01.657957 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b343dea4-4de9-4990-b29f-d674ad4a144e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:01.794178 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b343dea4-4de9-4990-b29f-d674ad4a144e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:01.802545 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b343dea4-4de9-4990-b29f-d674ad4a144e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.158355 Aug 03 12:13:01.803377 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 118/226] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:01 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:02.578702 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4d01acd7-89b3-433f-8c73-cfc5042f22c9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:02.579969 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-4d01acd7-89b3-433f-8c73-cfc5042f22c9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:02.587997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4d01acd7-89b3-433f-8c73-cfc5042f22c9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:02.588976 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4d01acd7-89b3-433f-8c73-cfc5042f22c9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:02.590166 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4d01acd7-89b3-433f-8c73-cfc5042f22c9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:02.590817 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4d01acd7-89b3-433f-8c73-cfc5042f22c9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:02.825991 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f3797013-6118-4272-9392-6022d2d41ac1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:02.826865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f3797013-6118-4272-9392-6022d2d41ac1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:02.836349 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f3797013-6118-4272-9392-6022d2d41ac1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:02.837115 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f3797013-6118-4272-9392-6022d2d41ac1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:02.838347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f3797013-6118-4272-9392-6022d2d41ac1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:02.839430 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f3797013-6118-4272-9392-6022d2d41ac1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:02.917732 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-4d01acd7-89b3-433f-8c73-cfc5042f22c9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:02.935678 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-4d01acd7-89b3-433f-8c73-cfc5042f22c9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1363 microversion: 2.1 time: 0.362247 Aug 03 12:13:02.936653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 109/227] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:02 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1363 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:03.011863 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f3797013-6118-4272-9392-6022d2d41ac1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:03.019983 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f3797013-6118-4272-9392-6022d2d41ac1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.199022 Aug 03 12:13:03.020554 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 119/228] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:02 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:13:03.197538 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-924930e2-b960-418d-b2c1-b922713e50e7 req-b4551a9f-6f1b-4bcb-9395-6c656502c9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed09302a-b62b-4353-976f-e47444e0dda4", "tag": "81055a13-727c-42c8-b797-93ca848ece8c"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:03.210557 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-924930e2-b960-418d-b2c1-b922713e50e7 req-b4551a9f-6f1b-4bcb-9395-6c656502c9c1 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:03.211280 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-924930e2-b960-418d-b2c1-b922713e50e7 req-b4551a9f-6f1b-4bcb-9395-6c656502c9c1 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:03.223963 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-924930e2-b960-418d-b2c1-b922713e50e7 req-b4551a9f-6f1b-4bcb-9395-6c656502c9c1 service nova] Creating event network-changed:81055a13-727c-42c8-b797-93ca848ece8c for instance ed09302a-b62b-4353-976f-e47444e0dda4 on hv-cinder-83602 Aug 03 12:13:03.243343 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-924930e2-b960-418d-b2c1-b922713e50e7 req-b4551a9f-6f1b-4bcb-9395-6c656502c9c1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049291 Aug 03 12:13:03.243707 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 110/229] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:13:03.957733 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4f4f2925-ada9-4c14-a2ce-c248b291e91d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:03.959953 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4f4f2925-ada9-4c14-a2ce-c248b291e91d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:03.970119 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f4f2925-ada9-4c14-a2ce-c248b291e91d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:03.970949 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f4f2925-ada9-4c14-a2ce-c248b291e91d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:03.971740 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f4f2925-ada9-4c14-a2ce-c248b291e91d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:03.972335 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f4f2925-ada9-4c14-a2ce-c248b291e91d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:04.044622 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c138a7fd-be5a-40e7-892f-5412e05a3eb0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:04.046020 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-c138a7fd-be5a-40e7-892f-5412e05a3eb0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:04.054532 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c138a7fd-be5a-40e7-892f-5412e05a3eb0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:04.056385 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c138a7fd-be5a-40e7-892f-5412e05a3eb0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:04.057593 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c138a7fd-be5a-40e7-892f-5412e05a3eb0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:04.058038 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c138a7fd-be5a-40e7-892f-5412e05a3eb0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:04.176446 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4f4f2925-ada9-4c14-a2ce-c248b291e91d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:04.184888 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4f4f2925-ada9-4c14-a2ce-c248b291e91d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1363 microversion: 2.1 time: 0.232089 Aug 03 12:13:04.185544 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 120/230] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:03 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:04.238826 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-c138a7fd-be5a-40e7-892f-5412e05a3eb0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:04.248675 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c138a7fd-be5a-40e7-892f-5412e05a3eb0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1521 microversion: 2.1 time: 0.210784 Aug 03 12:13:04.249083 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 111/231] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:04 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:05.208844 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5018867d-2db8-425d-aea3-497c7220d315 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:05.210061 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5018867d-2db8-425d-aea3-497c7220d315 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:05.216832 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5018867d-2db8-425d-aea3-497c7220d315 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:05.217278 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5018867d-2db8-425d-aea3-497c7220d315 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:05.218049 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5018867d-2db8-425d-aea3-497c7220d315 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:05.218506 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5018867d-2db8-425d-aea3-497c7220d315 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:05.275560 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-37f2df24-8075-428c-8828-400eb050856d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:05.277954 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-37f2df24-8075-428c-8828-400eb050856d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:05.288656 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37f2df24-8075-428c-8828-400eb050856d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:05.289270 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37f2df24-8075-428c-8828-400eb050856d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:05.290142 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37f2df24-8075-428c-8828-400eb050856d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:05.290609 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37f2df24-8075-428c-8828-400eb050856d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:05.410567 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5018867d-2db8-425d-aea3-497c7220d315 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:05.418625 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5018867d-2db8-425d-aea3-497c7220d315 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1363 microversion: 2.1 time: 0.216519 Aug 03 12:13:05.419934 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 121/232] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:05 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:05.487566 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-37f2df24-8075-428c-8828-400eb050856d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:05.499465 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-37f2df24-8075-428c-8828-400eb050856d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1501 microversion: 2.1 time: 0.231401 Aug 03 12:13:05.500047 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 112/233] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:05 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1501 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:05.520961 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5921756a-6f37-4b1d-8537-90d3875ca38c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:05.521573 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5921756a-6f37-4b1d-8537-90d3875ca38c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:05.527854 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5921756a-6f37-4b1d-8537-90d3875ca38c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:05.528344 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5921756a-6f37-4b1d-8537-90d3875ca38c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:05.529067 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5921756a-6f37-4b1d-8537-90d3875ca38c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:05.529498 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5921756a-6f37-4b1d-8537-90d3875ca38c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:05.708725 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5921756a-6f37-4b1d-8537-90d3875ca38c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:05.722011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5921756a-6f37-4b1d-8537-90d3875ca38c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1513 microversion: 2.1 time: 0.203032 Aug 03 12:13:05.739013 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 122/234] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:05 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:06.452174 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6d84303f-78c2-4f0e-8747-0a3dd83eee89 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:06.452719 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-6d84303f-78c2-4f0e-8747-0a3dd83eee89 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:06.467247 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6d84303f-78c2-4f0e-8747-0a3dd83eee89 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:06.468088 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6d84303f-78c2-4f0e-8747-0a3dd83eee89 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:06.469170 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6d84303f-78c2-4f0e-8747-0a3dd83eee89 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:06.469857 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6d84303f-78c2-4f0e-8747-0a3dd83eee89 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:06.685788 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-6d84303f-78c2-4f0e-8747-0a3dd83eee89 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:06.694085 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6d84303f-78c2-4f0e-8747-0a3dd83eee89 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1363 microversion: 2.1 time: 0.255913 Aug 03 12:13:06.694766 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 113/235] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:06 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:07.512157 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-534580e1-69c3-47ae-b158-541a89a9503d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:07.516724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-534580e1-69c3-47ae-b158-541a89a9503d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:07.530655 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:07.532290 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:07.543485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-534580e1-69c3-47ae-b158-541a89a9503d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:07.543967 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-534580e1-69c3-47ae-b158-541a89a9503d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:07.544744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-534580e1-69c3-47ae-b158-541a89a9503d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:07.545183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-534580e1-69c3-47ae-b158-541a89a9503d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:07.588028 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-534580e1-69c3-47ae-b158-541a89a9503d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lazy-loading 'flavor' on Instance uuid 2dec6dd8-d607-422d-a774-65c4288a977a {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:13:07.717990 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-17278d53-2435-4704-9d13-a9bc7aefaf5e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:07.718851 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-17278d53-2435-4704-9d13-a9bc7aefaf5e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:07.721545 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=6 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:07.733071 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-17278d53-2435-4704-9d13-a9bc7aefaf5e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:07.734200 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-17278d53-2435-4704-9d13-a9bc7aefaf5e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:07.735335 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-17278d53-2435-4704-9d13-a9bc7aefaf5e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:07.735768 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-17278d53-2435-4704-9d13-a9bc7aefaf5e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:07.751768 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-534580e1-69c3-47ae-b158-541a89a9503d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "POST /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a/action" status: 200 len: 32 microversion: 2.1 time: 0.242023 Aug 03 12:13:07.754081 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 123/236] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:13:07 2022] POST /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a/action => generated 32 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 12:13:07.768276 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5f6d180d-77f5-4c8b-961d-e04bd9493240 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:07.769173 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5f6d180d-77f5-4c8b-961d-e04bd9493240 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:07.777427 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5f6d180d-77f5-4c8b-961d-e04bd9493240 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:07.778319 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5f6d180d-77f5-4c8b-961d-e04bd9493240 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:07.779390 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5f6d180d-77f5-4c8b-961d-e04bd9493240 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:07.780164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5f6d180d-77f5-4c8b-961d-e04bd9493240 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:08.044464 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5f6d180d-77f5-4c8b-961d-e04bd9493240 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:08.061338 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5f6d180d-77f5-4c8b-961d-e04bd9493240 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.298049 Aug 03 12:13:08.077274 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 124/237] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:07 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:08.095127 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-17278d53-2435-4704-9d13-a9bc7aefaf5e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:08.108836 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-17278d53-2435-4704-9d13-a9bc7aefaf5e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1363 microversion: 2.1 time: 0.395457 Aug 03 12:13:08.111772 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 114/238] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:07 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1363 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:09.089179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a6c506ae-0f01-48b8-aa3a-7aa89b4afe0b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:09.093523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a6c506ae-0f01-48b8-aa3a-7aa89b4afe0b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:09.096500 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a6c506ae-0f01-48b8-aa3a-7aa89b4afe0b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:09.096934 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a6c506ae-0f01-48b8-aa3a-7aa89b4afe0b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:09.097713 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a6c506ae-0f01-48b8-aa3a-7aa89b4afe0b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:09.098335 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a6c506ae-0f01-48b8-aa3a-7aa89b4afe0b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:09.129380 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a2c209f6-7ba6-47ef-a883-013fde03bcc5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:09.130076 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a2c209f6-7ba6-47ef-a883-013fde03bcc5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:09.137711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a2c209f6-7ba6-47ef-a883-013fde03bcc5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:09.138508 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a2c209f6-7ba6-47ef-a883-013fde03bcc5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:09.143332 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a2c209f6-7ba6-47ef-a883-013fde03bcc5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:09.143825 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a2c209f6-7ba6-47ef-a883-013fde03bcc5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:09.246895 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a6c506ae-0f01-48b8-aa3a-7aa89b4afe0b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:09.254775 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a6c506ae-0f01-48b8-aa3a-7aa89b4afe0b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.170274 Aug 03 12:13:09.256993 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 125/239] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:09 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:09.308834 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a2c209f6-7ba6-47ef-a883-013fde03bcc5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:09.316735 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a2c209f6-7ba6-47ef-a883-013fde03bcc5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1363 microversion: 2.1 time: 0.191173 Aug 03 12:13:09.317347 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 115/240] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:09 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:10.279326 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3b60131e-a989-4304-9f07-78e25351e091 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:10.280126 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3b60131e-a989-4304-9f07-78e25351e091 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:10.287486 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3b60131e-a989-4304-9f07-78e25351e091 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:10.288267 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3b60131e-a989-4304-9f07-78e25351e091 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:10.289168 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3b60131e-a989-4304-9f07-78e25351e091 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:10.290692 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3b60131e-a989-4304-9f07-78e25351e091 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:10.341812 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2fe00746-3668-4b4c-9901-8aa6792c42cd tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:10.342434 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2fe00746-3668-4b4c-9901-8aa6792c42cd tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:10.352876 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2fe00746-3668-4b4c-9901-8aa6792c42cd tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:10.353581 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2fe00746-3668-4b4c-9901-8aa6792c42cd tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:10.354555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2fe00746-3668-4b4c-9901-8aa6792c42cd tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:10.355143 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2fe00746-3668-4b4c-9901-8aa6792c42cd tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:10.469010 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3b60131e-a989-4304-9f07-78e25351e091 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:10.478397 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3b60131e-a989-4304-9f07-78e25351e091 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.204781 Aug 03 12:13:10.488746 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 126/241] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:10 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:10.737466 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2fe00746-3668-4b4c-9901-8aa6792c42cd tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:10.746979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2fe00746-3668-4b4c-9901-8aa6792c42cd tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1363 microversion: 2.1 time: 0.411252 Aug 03 12:13:10.748025 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 116/242] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:10 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1363 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:11.500293 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9eca2ed2-3ff9-4fb0-a88f-660076ff2afb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:11.501074 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9eca2ed2-3ff9-4fb0-a88f-660076ff2afb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:11.504798 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:11.520081 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9eca2ed2-3ff9-4fb0-a88f-660076ff2afb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:11.521737 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9eca2ed2-3ff9-4fb0-a88f-660076ff2afb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:11.524101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9eca2ed2-3ff9-4fb0-a88f-660076ff2afb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:11.527494 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9eca2ed2-3ff9-4fb0-a88f-660076ff2afb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:11.760270 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9eca2ed2-3ff9-4fb0-a88f-660076ff2afb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:11.769855 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9eca2ed2-3ff9-4fb0-a88f-660076ff2afb tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.273449 Aug 03 12:13:11.770529 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 127/243] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:11 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:11.780888 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3bdd4122-3b04-47a4-87ea-28cf35b3ca09 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:11.781742 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-3bdd4122-3b04-47a4-87ea-28cf35b3ca09 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:11.794885 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3bdd4122-3b04-47a4-87ea-28cf35b3ca09 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:11.795552 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3bdd4122-3b04-47a4-87ea-28cf35b3ca09 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:11.796516 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3bdd4122-3b04-47a4-87ea-28cf35b3ca09 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:11.797110 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3bdd4122-3b04-47a4-87ea-28cf35b3ca09 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:12.128850 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-3bdd4122-3b04-47a4-87ea-28cf35b3ca09 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:12.137971 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-3bdd4122-3b04-47a4-87ea-28cf35b3ca09 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1363 microversion: 2.1 time: 0.360877 Aug 03 12:13:12.139009 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 117/244] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:11 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:12.791960 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-14956c05-f356-40da-a7a6-74e388bb492a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:12.793476 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-14956c05-f356-40da-a7a6-74e388bb492a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:12.799825 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-14956c05-f356-40da-a7a6-74e388bb492a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:12.800278 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-14956c05-f356-40da-a7a6-74e388bb492a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:12.801049 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-14956c05-f356-40da-a7a6-74e388bb492a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:12.801489 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-14956c05-f356-40da-a7a6-74e388bb492a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:12.820391 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:13.019861 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-14956c05-f356-40da-a7a6-74e388bb492a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:13.027758 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-14956c05-f356-40da-a7a6-74e388bb492a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.240366 Aug 03 12:13:13.028357 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 128/245] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:12 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:13.176023 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f3a3c949-c7f8-43af-bdb0-eefe7ba77c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:13.177113 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f3a3c949-c7f8-43af-bdb0-eefe7ba77c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:13.184524 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:13.187145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f3a3c949-c7f8-43af-bdb0-eefe7ba77c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:13.187991 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f3a3c949-c7f8-43af-bdb0-eefe7ba77c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:13.188963 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f3a3c949-c7f8-43af-bdb0-eefe7ba77c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:13.189631 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f3a3c949-c7f8-43af-bdb0-eefe7ba77c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:13.456298 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f3a3c949-c7f8-43af-bdb0-eefe7ba77c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:13.467223 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f3a3c949-c7f8-43af-bdb0-eefe7ba77c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1363 microversion: 2.1 time: 0.296513 Aug 03 12:13:13.468623 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 118/246] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:13 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:14.053883 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6e46f9b9-f6f9-482b-9563-c7518b7419fd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:14.055097 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6e46f9b9-f6f9-482b-9563-c7518b7419fd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:14.062037 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6e46f9b9-f6f9-482b-9563-c7518b7419fd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:14.062800 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6e46f9b9-f6f9-482b-9563-c7518b7419fd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:14.063743 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6e46f9b9-f6f9-482b-9563-c7518b7419fd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:14.064331 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6e46f9b9-f6f9-482b-9563-c7518b7419fd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:14.293659 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6e46f9b9-f6f9-482b-9563-c7518b7419fd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:14.321419 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6e46f9b9-f6f9-482b-9563-c7518b7419fd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.273423 Aug 03 12:13:14.322400 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 129/247] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:14 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:14.493528 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d1868578-c7b5-4400-ba9d-0ce915041679 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:14.494207 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d1868578-c7b5-4400-ba9d-0ce915041679 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:14.506091 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d1868578-c7b5-4400-ba9d-0ce915041679 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:14.509145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d1868578-c7b5-4400-ba9d-0ce915041679 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:14.518264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d1868578-c7b5-4400-ba9d-0ce915041679 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:14.518789 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d1868578-c7b5-4400-ba9d-0ce915041679 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:14.851157 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d1868578-c7b5-4400-ba9d-0ce915041679 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:14.861135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d1868578-c7b5-4400-ba9d-0ce915041679 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1363 microversion: 2.1 time: 0.371531 Aug 03 12:13:14.862991 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 119/248] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:14 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1363 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:15.010411 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-283ddc12-bd6f-4f08-9cf1-9a8bfd185a05 req-62c13db6-4b30-4a43-89e3-7ec79743f575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed09302a-b62b-4353-976f-e47444e0dda4", "name": "network-vif-plugged", "status": "completed", "tag": "81055a13-727c-42c8-b797-93ca848ece8c"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:15.028250 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-283ddc12-bd6f-4f08-9cf1-9a8bfd185a05 req-62c13db6-4b30-4a43-89e3-7ec79743f575 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:15.029889 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-283ddc12-bd6f-4f08-9cf1-9a8bfd185a05 req-62c13db6-4b30-4a43-89e3-7ec79743f575 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:15.057409 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-283ddc12-bd6f-4f08-9cf1-9a8bfd185a05 req-62c13db6-4b30-4a43-89e3-7ec79743f575 service nova] Creating event network-vif-plugged:81055a13-727c-42c8-b797-93ca848ece8c for instance ed09302a-b62b-4353-976f-e47444e0dda4 on hv-cinder-83602 Aug 03 12:13:15.074806 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-283ddc12-bd6f-4f08-9cf1-9a8bfd185a05 req-62c13db6-4b30-4a43-89e3-7ec79743f575 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070293 Aug 03 12:13:15.077776 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 130/249] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:13:15.345718 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-92e81b36-7c39-4db0-b68a-75bbbbb8c9e8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:15.346100 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-92e81b36-7c39-4db0-b68a-75bbbbb8c9e8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:15.353582 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-92e81b36-7c39-4db0-b68a-75bbbbb8c9e8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:15.354396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-92e81b36-7c39-4db0-b68a-75bbbbb8c9e8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:15.355791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-92e81b36-7c39-4db0-b68a-75bbbbb8c9e8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:15.356591 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-92e81b36-7c39-4db0-b68a-75bbbbb8c9e8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:15.562094 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-92e81b36-7c39-4db0-b68a-75bbbbb8c9e8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:15.572514 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-92e81b36-7c39-4db0-b68a-75bbbbb8c9e8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.230789 Aug 03 12:13:15.587121 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 120/250] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:15 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:15.887650 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-92993015-0423-4599-9a8a-d6729e340413 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:15.888492 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-92993015-0423-4599-9a8a-d6729e340413 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:15.900004 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-92993015-0423-4599-9a8a-d6729e340413 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:15.902016 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-92993015-0423-4599-9a8a-d6729e340413 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:15.902830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-92993015-0423-4599-9a8a-d6729e340413 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:15.903273 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-92993015-0423-4599-9a8a-d6729e340413 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:16.093429 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-92993015-0423-4599-9a8a-d6729e340413 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:16.101526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-92993015-0423-4599-9a8a-d6729e340413 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1363 microversion: 2.1 time: 0.220934 Aug 03 12:13:16.102691 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 131/251] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:15 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:16.596008 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-48607886-1618-444f-a3fa-fe916d1f9afa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:16.596696 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-48607886-1618-444f-a3fa-fe916d1f9afa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:16.613185 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-48607886-1618-444f-a3fa-fe916d1f9afa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:16.614685 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-48607886-1618-444f-a3fa-fe916d1f9afa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:16.615495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-48607886-1618-444f-a3fa-fe916d1f9afa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:16.619228 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-48607886-1618-444f-a3fa-fe916d1f9afa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:16.663738 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=100 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:16.817769 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-48607886-1618-444f-a3fa-fe916d1f9afa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:16.829729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-48607886-1618-444f-a3fa-fe916d1f9afa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.238725 Aug 03 12:13:16.831432 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 121/252] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:16 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:17.123513 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-33244f84-414b-4364-b34f-76ee3d4d08f4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:17.124704 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-33244f84-414b-4364-b34f-76ee3d4d08f4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:17.131610 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-33244f84-414b-4364-b34f-76ee3d4d08f4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:17.132347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-33244f84-414b-4364-b34f-76ee3d4d08f4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:17.133129 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-33244f84-414b-4364-b34f-76ee3d4d08f4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:17.134104 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-33244f84-414b-4364-b34f-76ee3d4d08f4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:17.511611 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-33244f84-414b-4364-b34f-76ee3d4d08f4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:17.520913 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-33244f84-414b-4364-b34f-76ee3d4d08f4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1363 microversion: 2.1 time: 0.401085 Aug 03 12:13:17.522845 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 132/253] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:17 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:17.853455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ab8d6b16-c436-4f79-b727-d6b4628dfdab tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:17.854768 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-ab8d6b16-c436-4f79-b727-d6b4628dfdab tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:17.868349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ab8d6b16-c436-4f79-b727-d6b4628dfdab tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:17.869068 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ab8d6b16-c436-4f79-b727-d6b4628dfdab tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:17.870820 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ab8d6b16-c436-4f79-b727-d6b4628dfdab tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:17.871862 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ab8d6b16-c436-4f79-b727-d6b4628dfdab tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:18.151508 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ab8d6b16-c436-4f79-b727-d6b4628dfdab tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:18.167517 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ab8d6b16-c436-4f79-b727-d6b4628dfdab tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.318358 Aug 03 12:13:18.183069 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 122/254] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:17 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:18.545743 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1f0ec1a4-a745-478d-b097-032d006bea8b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:18.546692 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1f0ec1a4-a745-478d-b097-032d006bea8b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:18.584580 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1f0ec1a4-a745-478d-b097-032d006bea8b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:18.585703 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1f0ec1a4-a745-478d-b097-032d006bea8b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:18.588457 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1f0ec1a4-a745-478d-b097-032d006bea8b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:18.589489 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1f0ec1a4-a745-478d-b097-032d006bea8b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:19.087308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1f0ec1a4-a745-478d-b097-032d006bea8b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:19.104574 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1f0ec1a4-a745-478d-b097-032d006bea8b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1363 microversion: 2.1 time: 0.562441 Aug 03 12:13:19.123278 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 133/255] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:18 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1363 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:19.193256 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-da5da96d-2b7b-4404-b5b3-8702343d5200 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:19.193889 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-da5da96d-2b7b-4404-b5b3-8702343d5200 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:19.203470 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-da5da96d-2b7b-4404-b5b3-8702343d5200 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:19.203922 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-da5da96d-2b7b-4404-b5b3-8702343d5200 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:19.204776 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-da5da96d-2b7b-4404-b5b3-8702343d5200 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:19.205259 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-da5da96d-2b7b-4404-b5b3-8702343d5200 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:19.833794 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-da5da96d-2b7b-4404-b5b3-8702343d5200 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:19.849083 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-da5da96d-2b7b-4404-b5b3-8702343d5200 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.659693 Aug 03 12:13:19.850893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 123/256] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:19 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:20.129589 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-375d1e3e-a5c4-43ba-af6b-e59a33fd094d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:20.130398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-375d1e3e-a5c4-43ba-af6b-e59a33fd094d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:20.147481 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-375d1e3e-a5c4-43ba-af6b-e59a33fd094d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:20.151449 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-375d1e3e-a5c4-43ba-af6b-e59a33fd094d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:20.156533 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-375d1e3e-a5c4-43ba-af6b-e59a33fd094d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:20.157991 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-375d1e3e-a5c4-43ba-af6b-e59a33fd094d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:20.527393 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-375d1e3e-a5c4-43ba-af6b-e59a33fd094d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:20.535373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-375d1e3e-a5c4-43ba-af6b-e59a33fd094d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1548 microversion: 2.1 time: 0.411721 Aug 03 12:13:20.535972 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 134/257] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:20 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1548 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:20.574020 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c2a7a3be-399e-4b69-90d9-92764896b6b4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:20.576326 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-c2a7a3be-399e-4b69-90d9-92764896b6b4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:20.585350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c2a7a3be-399e-4b69-90d9-92764896b6b4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:20.586217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c2a7a3be-399e-4b69-90d9-92764896b6b4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:20.589929 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c2a7a3be-399e-4b69-90d9-92764896b6b4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:20.592358 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c2a7a3be-399e-4b69-90d9-92764896b6b4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:20.734533 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c2a7a3be-399e-4b69-90d9-92764896b6b4 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167146 Aug 03 12:13:20.735413 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 124/258] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 3 12:13:20 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:13:20.876976 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c69857bd-1a00-451e-b607-e55de83ec572 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:20.878135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c69857bd-1a00-451e-b607-e55de83ec572 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:20.888388 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c69857bd-1a00-451e-b607-e55de83ec572 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:20.888874 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c69857bd-1a00-451e-b607-e55de83ec572 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:20.891390 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c69857bd-1a00-451e-b607-e55de83ec572 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:20.891846 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c69857bd-1a00-451e-b607-e55de83ec572 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:21.147788 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c69857bd-1a00-451e-b607-e55de83ec572 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:21.165180 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c69857bd-1a00-451e-b607-e55de83ec572 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.290734 Aug 03 12:13:21.167437 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 135/259] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:20 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:22.191117 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c3c09322-1004-4a7b-b946-7004498198dd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:22.192390 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-c3c09322-1004-4a7b-b946-7004498198dd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:22.211329 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c3c09322-1004-4a7b-b946-7004498198dd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:22.216072 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c3c09322-1004-4a7b-b946-7004498198dd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:22.217267 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c3c09322-1004-4a7b-b946-7004498198dd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:22.218018 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c3c09322-1004-4a7b-b946-7004498198dd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:22.662140 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-c3c09322-1004-4a7b-b946-7004498198dd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:22.672525 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c3c09322-1004-4a7b-b946-7004498198dd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.485397 Aug 03 12:13:22.676858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 125/260] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:22 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:23.496304 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-850318f0-5cd3-452c-ab51-099abc524de3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Action: 'create', calling method: .version_select at 0x7f14dc1ec4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1695578460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJf5MzfJdRCESPTAuyELJyRcTXpzkZ3VaqawzdKGDvznClkQcaw80D4FGzmNiYY2WwbvbXqt5sI26Sh38HuyLkjMkkKUbjHwQEGQBJluYXPlKNp0E2JBdGGxcsY78thvw=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:23.542904 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-850318f0-5cd3-452c-ab51-099abc524de3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Getting quotas for project 1a4c09dba5b24ef5b37b730b259d3790. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:13:23.567833 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-a327d1ca-6ab5-4df0-911c-90d8f579b64b req-0b6b5906-c953-4035-8327-7e0ab1ba1403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed09302a-b62b-4353-976f-e47444e0dda4", "tag": "81055a13-727c-42c8-b797-93ca848ece8c"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:23.575737 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-850318f0-5cd3-452c-ab51-099abc524de3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Getting quotas for user 5cf524f6288040219c0492d3a794e830 and project 1a4c09dba5b24ef5b37b730b259d3790. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:13:23.600957 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-a327d1ca-6ab5-4df0-911c-90d8f579b64b req-0b6b5906-c953-4035-8327-7e0ab1ba1403 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:23.614259 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-a327d1ca-6ab5-4df0-911c-90d8f579b64b req-0b6b5906-c953-4035-8327-7e0ab1ba1403 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:23.628930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-850318f0-5cd3-452c-ab51-099abc524de3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.468878 Aug 03 12:13:23.641581 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 136/261] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 3 12:13:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:13:23.655759 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-a327d1ca-6ab5-4df0-911c-90d8f579b64b req-0b6b5906-c953-4035-8327-7e0ab1ba1403 service nova] Creating event network-changed:81055a13-727c-42c8-b797-93ca848ece8c for instance ed09302a-b62b-4353-976f-e47444e0dda4 on hv-cinder-83602 Aug 03 12:13:23.688760 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-a327d1ca-6ab5-4df0-911c-90d8f579b64b req-0b6b5906-c953-4035-8327-7e0ab1ba1403 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139545 Aug 03 12:13:23.692036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 126/262] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:13:23.698353 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2d33d177-4779-4b4c-9410-9a7cfc787bee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:23.699005 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2d33d177-4779-4b4c-9410-9a7cfc787bee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:23.714743 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d33d177-4779-4b4c-9410-9a7cfc787bee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:23.717179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d33d177-4779-4b4c-9410-9a7cfc787bee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:23.722807 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d33d177-4779-4b4c-9410-9a7cfc787bee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:23.724312 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d33d177-4779-4b4c-9410-9a7cfc787bee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:24.168562 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2d33d177-4779-4b4c-9410-9a7cfc787bee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:24.176958 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2d33d177-4779-4b4c-9410-9a7cfc787bee tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.483563 Aug 03 12:13:24.177557 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 137/263] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:23 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:24.968421 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e2bc4e80-cc2d-426a-942c-b9a385d8f681 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:24.969539 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e2bc4e80-cc2d-426a-942c-b9a385d8f681 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:24.979288 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e2bc4e80-cc2d-426a-942c-b9a385d8f681 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:24.979929 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e2bc4e80-cc2d-426a-942c-b9a385d8f681 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:24.980733 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e2bc4e80-cc2d-426a-942c-b9a385d8f681 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:24.982335 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e2bc4e80-cc2d-426a-942c-b9a385d8f681 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:25.047099 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e2bc4e80-cc2d-426a-942c-b9a385d8f681 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05/ips" status: 200 len: 150 microversion: 2.1 time: 0.084957 Aug 03 12:13:25.050587 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 127/264] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 3 12:13:24 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05/ips => generated 150 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:13:25.199239 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5ab52c36-c9b6-474c-80ed-d8d414a884a7 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:25.199843 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5ab52c36-c9b6-474c-80ed-d8d414a884a7 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:25.206619 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5ab52c36-c9b6-474c-80ed-d8d414a884a7 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:25.207180 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5ab52c36-c9b6-474c-80ed-d8d414a884a7 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:25.207959 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5ab52c36-c9b6-474c-80ed-d8d414a884a7 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:25.208323 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5ab52c36-c9b6-474c-80ed-d8d414a884a7 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:25.528497 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3b0304d7-64cf-46f3-b159-da59c2221e44 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:25.529416 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-3b0304d7-64cf-46f3-b159-da59c2221e44 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:25.545658 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3b0304d7-64cf-46f3-b159-da59c2221e44 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:25.546913 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3b0304d7-64cf-46f3-b159-da59c2221e44 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:25.548731 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3b0304d7-64cf-46f3-b159-da59c2221e44 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:25.550272 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5ab52c36-c9b6-474c-80ed-d8d414a884a7 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:25.561208 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5ab52c36-c9b6-474c-80ed-d8d414a884a7 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.366346 Aug 03 12:13:25.563142 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 138/265] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:25 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:25.563318 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3b0304d7-64cf-46f3-b159-da59c2221e44 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:25.640908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-3b0304d7-64cf-46f3-b159-da59c2221e44 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/ips" status: 200 len: 151 microversion: 2.20 time: 0.117681 Aug 03 12:13:25.650217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 128/266] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Aug 3 12:13:25 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/ips => generated 151 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:13:26.607886 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ddb92c3c-2890-4dd5-bc81-d574adabfbb9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:26.610052 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ddb92c3c-2890-4dd5-bc81-d574adabfbb9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:26.629139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ddb92c3c-2890-4dd5-bc81-d574adabfbb9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:26.631965 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ddb92c3c-2890-4dd5-bc81-d574adabfbb9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:26.634872 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ddb92c3c-2890-4dd5-bc81-d574adabfbb9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:26.635540 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ddb92c3c-2890-4dd5-bc81-d574adabfbb9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:26.823345 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-bcbba425-3ed9-4300-8196-787f8e982337 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "660e1707-36bd-47f8-98de-1a96555b9ee5"}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:26.827814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-bcbba425-3ed9-4300-8196-787f8e982337 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:26.856337 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bcbba425-3ed9-4300-8196-787f8e982337 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:26.875034 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bcbba425-3ed9-4300-8196-787f8e982337 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:26.875034 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bcbba425-3ed9-4300-8196-787f8e982337 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:26.875034 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bcbba425-3ed9-4300-8196-787f8e982337 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:27.012714 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ddb92c3c-2890-4dd5-bc81-d574adabfbb9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:27.046570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ddb92c3c-2890-4dd5-bc81-d574adabfbb9 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.458709 Aug 03 12:13:27.049487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 139/267] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:26 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:27.935322 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-bcbba425-3ed9-4300-8196-787f8e982337 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "POST /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.116747 Aug 03 12:13:27.937875 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 129/268] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:13:26 2022] POST /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05/os-volume_attachments => generated 194 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:13:28.072410 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-491065f0-9581-4472-8977-0e9af9cc0840 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:28.073229 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-491065f0-9581-4472-8977-0e9af9cc0840 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:28.081850 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-491065f0-9581-4472-8977-0e9af9cc0840 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:28.087279 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-491065f0-9581-4472-8977-0e9af9cc0840 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:28.092271 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-491065f0-9581-4472-8977-0e9af9cc0840 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:28.093291 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-491065f0-9581-4472-8977-0e9af9cc0840 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:28.543346 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-491065f0-9581-4472-8977-0e9af9cc0840 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:28.551440 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-491065f0-9581-4472-8977-0e9af9cc0840 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.485029 Aug 03 12:13:28.571654 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 140/269] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:28 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:29.537694 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-37fbea9c-6203-443f-a6a4-ce5a896bda67 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:29.538522 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-37fbea9c-6203-443f-a6a4-ce5a896bda67 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:29.546252 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37fbea9c-6203-443f-a6a4-ce5a896bda67 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:29.547134 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37fbea9c-6203-443f-a6a4-ce5a896bda67 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:29.548189 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37fbea9c-6203-443f-a6a4-ce5a896bda67 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:29.548773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37fbea9c-6203-443f-a6a4-ce5a896bda67 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:29.582574 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c7e34c75-f29f-48af-97bb-729b5ce9963c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:29.583541 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c7e34c75-f29f-48af-97bb-729b5ce9963c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:29.594755 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7e34c75-f29f-48af-97bb-729b5ce9963c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:29.596260 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7e34c75-f29f-48af-97bb-729b5ce9963c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:29.598573 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-37fbea9c-6203-443f-a6a4-ce5a896bda67 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lazy-loading 'flavor' on Instance uuid 4afb38cd-ec9c-4509-b7c8-91b170684ec5 {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:13:29.600401 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7e34c75-f29f-48af-97bb-729b5ce9963c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:29.601069 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7e34c75-f29f-48af-97bb-729b5ce9963c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:29.884278 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c7e34c75-f29f-48af-97bb-729b5ce9963c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:29.895596 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c7e34c75-f29f-48af-97bb-729b5ce9963c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.318598 Aug 03 12:13:29.896744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 141/270] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:29 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:13:30.038317 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-37fbea9c-6203-443f-a6a4-ce5a896bda67 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "POST /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/action" status: 202 len: 0 microversion: 2.20 time: 0.506556 Aug 03 12:13:30.039395 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 130/271] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Aug 3 12:13:29 2022] POST /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:13:30.052484 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b136ac42-314e-4118-a52b-a6bc2116e980 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:30.053577 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b136ac42-314e-4118-a52b-a6bc2116e980 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:30.082367 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b136ac42-314e-4118-a52b-a6bc2116e980 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:30.084221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b136ac42-314e-4118-a52b-a6bc2116e980 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:30.087174 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b136ac42-314e-4118-a52b-a6bc2116e980 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:30.116051 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b136ac42-314e-4118-a52b-a6bc2116e980 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:30.660073 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b136ac42-314e-4118-a52b-a6bc2116e980 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:30.674764 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b136ac42-314e-4118-a52b-a6bc2116e980 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:30.676842 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b136ac42-314e-4118-a52b-a6bc2116e980 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:30.678372 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b136ac42-314e-4118-a52b-a6bc2116e980 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1723 microversion: 2.20 time: 0.633706 Aug 03 12:13:30.684288 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 142/272] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:30 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1723 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:13:30.919138 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-8147d00e-6865-420b-9d8e-ec393271cf1d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:30.920510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-8147d00e-6865-420b-9d8e-ec393271cf1d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:30.928110 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8147d00e-6865-420b-9d8e-ec393271cf1d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:30.928906 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8147d00e-6865-420b-9d8e-ec393271cf1d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:30.935132 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8147d00e-6865-420b-9d8e-ec393271cf1d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:30.936650 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8147d00e-6865-420b-9d8e-ec393271cf1d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:31.563233 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-8147d00e-6865-420b-9d8e-ec393271cf1d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:31.579731 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-8147d00e-6865-420b-9d8e-ec393271cf1d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1499 microversion: 2.1 time: 0.665370 Aug 03 12:13:31.581037 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 131/273] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:30 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1499 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:31.611172 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f8076814-fa5b-42b8-925d-0e15d2997542 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc4960e6-53e1-4466-8426-83756a0f8e61"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:31.615114 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f8076814-fa5b-42b8-925d-0e15d2997542 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:31.646227 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8076814-fa5b-42b8-925d-0e15d2997542 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:31.646715 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8076814-fa5b-42b8-925d-0e15d2997542 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:31.647720 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8076814-fa5b-42b8-925d-0e15d2997542 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:31.648312 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8076814-fa5b-42b8-925d-0e15d2997542 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:31.708234 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-37690b47-445c-46c9-b20e-bb01828ee0bc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:31.709698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-37690b47-445c-46c9-b20e-bb01828ee0bc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:31.711166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-f8076814-fa5b-42b8-925d-0e15d2997542 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] HTTP exception thrown: Cannot 'attach_volume' instance 2dec6dd8-d607-422d-a774-65c4288a977a while it is in vm_state rescued Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f8076814-fa5b-42b8-925d-0e15d2997542 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Request method failure captured: Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: POST /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a/os-volume_attachments HTTP/1.1 Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 74 Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXpGgstOLCAy1IlP8axU4h3RqjCWiCOjN6ADxKbHRwEqWKAJbyQSVt-GY6L_iKrgzC0QBQEwSacUOcec64z9asz0SHu9FitUawVbzLJtXhCKgLQERKvuYBNI9_B_4tm1yF1ahiKM6J-qYB618EPmimAvbmvR6h-16Prn4spPy7fhlo Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: d51be67fb4974085b55f3dcfcc2c70aa Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:13:31.712902 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:13:31.714130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d51be67fb4974085b55f3dcfcc2c70aa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:13:31.714130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:13:31.714130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: d51be67fb4974085b55f3dcfcc2c70aa Aug 03 12:13:31.714130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:13:31.714130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-ServerRescueNegativeTestJSON-350268690-project Aug 03 12:13:31.714130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:13:31.714130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:13:31.714130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: cde9db32ba1c4810833f8fd824536347 Aug 03 12:13:31.714130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-ServerRescueNegativeTestJSON-350268690-project Aug 03 12:13:31.714130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Aug 03 12:13:31.714130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {"volumeAttachment": {"volumeId": "dc4960e6-53e1-4466-8426-83756a0f8e61"}} Aug 03 12:13:31.714130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Cannot 'attach_volume' instance 2dec6dd8-d607-422d-a774-65c4288a977a while it is in vm_state rescued Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'server_id': '2dec6dd8-d607-422d-a774-65c4288a977a', 'body': {'volumeAttachment': {'volumeId': 'dc4960e6-53e1-4466-8426-83756a0f8e61'}}} Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2dec6dd8-d607-422d-a774-65c4288a977a in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:13:31.714925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2dec6dd8-d607-422d-a774-65c4288a977a while it is in vm_state rescued Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:13:31.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:13:31.717103 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:13:31.717103 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:13:31.717103 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2dec6dd8-d607-422d-a774-65c4288a977a while it is in vm_state rescued Aug 03 12:13:31.717103 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:13:31.717103 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f8076814-fa5b-42b8-925d-0e15d2997542 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Returning 409 to user: Cannot 'attach_volume' instance 2dec6dd8-d607-422d-a774-65c4288a977a while it is in vm_state rescued {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:13:31.717652 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f8076814-fa5b-42b8-925d-0e15d2997542 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "POST /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.110126 Aug 03 12:13:31.723353 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 143/274] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:13:31 2022] POST /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a/os-volume_attachments => generated 152 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 12:13:31.728493 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37690b47-445c-46c9-b20e-bb01828ee0bc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:31.729179 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37690b47-445c-46c9-b20e-bb01828ee0bc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:31.731161 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37690b47-445c-46c9-b20e-bb01828ee0bc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:31.731724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37690b47-445c-46c9-b20e-bb01828ee0bc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:31.731981 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-79b143a2-9498-47e5-a872-59b69bd4aca4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:31.732549 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-79b143a2-9498-47e5-a872-59b69bd4aca4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:31.744030 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-79b143a2-9498-47e5-a872-59b69bd4aca4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:31.750319 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-79b143a2-9498-47e5-a872-59b69bd4aca4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:31.760226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-79b143a2-9498-47e5-a872-59b69bd4aca4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:31.760919 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-79b143a2-9498-47e5-a872-59b69bd4aca4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:31.909032 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-79b143a2-9498-47e5-a872-59b69bd4aca4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "POST /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a/action" status: 202 len: 0 microversion: 2.1 time: 0.180748 Aug 03 12:13:31.912771 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 144/275] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:13:31 2022] POST /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 12:13:31.946887 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-21100465-06d2-44c4-9a7c-850b22fa7692 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:31.950507 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-21100465-06d2-44c4-9a7c-850b22fa7692 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:31.961564 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21100465-06d2-44c4-9a7c-850b22fa7692 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:31.963441 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21100465-06d2-44c4-9a7c-850b22fa7692 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:31.964434 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21100465-06d2-44c4-9a7c-850b22fa7692 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:31.965046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21100465-06d2-44c4-9a7c-850b22fa7692 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:32.325139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-21100465-06d2-44c4-9a7c-850b22fa7692 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:32.332827 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-21100465-06d2-44c4-9a7c-850b22fa7692 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1507 microversion: 2.1 time: 0.402531 Aug 03 12:13:32.358170 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 145/276] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:31 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1507 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:13:32.436484 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-37690b47-445c-46c9-b20e-bb01828ee0bc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:32.459124 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-37690b47-445c-46c9-b20e-bb01828ee0bc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:32.465179 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-37690b47-445c-46c9-b20e-bb01828ee0bc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:32.469302 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-37690b47-445c-46c9-b20e-bb01828ee0bc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1723 microversion: 2.20 time: 0.770406 Aug 03 12:13:32.474428 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 132/277] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:31 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1723 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:13:33.386145 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a0bc23f5-f67e-4912-a330-1710c5304adf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:33.387887 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a0bc23f5-f67e-4912-a330-1710c5304adf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:33.401693 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a0bc23f5-f67e-4912-a330-1710c5304adf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:33.402172 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a0bc23f5-f67e-4912-a330-1710c5304adf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:33.403808 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a0bc23f5-f67e-4912-a330-1710c5304adf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:33.404285 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a0bc23f5-f67e-4912-a330-1710c5304adf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:33.409676 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:33.507493 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b286b9bf-7bf4-41fc-96f0-02c5926ac40e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:33.509545 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b286b9bf-7bf4-41fc-96f0-02c5926ac40e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:33.536279 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b286b9bf-7bf4-41fc-96f0-02c5926ac40e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:33.537123 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b286b9bf-7bf4-41fc-96f0-02c5926ac40e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:33.538161 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b286b9bf-7bf4-41fc-96f0-02c5926ac40e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:33.541387 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b286b9bf-7bf4-41fc-96f0-02c5926ac40e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:33.657843 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=4 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:33.893500 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a0bc23f5-f67e-4912-a330-1710c5304adf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:33.914416 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a0bc23f5-f67e-4912-a330-1710c5304adf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1507 microversion: 2.1 time: 0.533323 Aug 03 12:13:33.915905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 146/278] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:33 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1507 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:33.961092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b286b9bf-7bf4-41fc-96f0-02c5926ac40e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:33.975515 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b286b9bf-7bf4-41fc-96f0-02c5926ac40e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:33.977964 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b286b9bf-7bf4-41fc-96f0-02c5926ac40e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:33.980010 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b286b9bf-7bf4-41fc-96f0-02c5926ac40e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1723 microversion: 2.20 time: 0.476206 Aug 03 12:13:33.995446 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 133/279] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:33 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1723 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:13:34.943287 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d5524688-9c13-466f-8db6-eeec2f77402c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:34.943914 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d5524688-9c13-466f-8db6-eeec2f77402c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:34.966686 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5524688-9c13-466f-8db6-eeec2f77402c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:34.967142 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5524688-9c13-466f-8db6-eeec2f77402c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:34.967946 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5524688-9c13-466f-8db6-eeec2f77402c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:34.968391 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d5524688-9c13-466f-8db6-eeec2f77402c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:35.005614 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cfb26408-11ee-4d9e-a7f6-d6a6535254f4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:35.006841 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-cfb26408-11ee-4d9e-a7f6-d6a6535254f4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:35.014123 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cfb26408-11ee-4d9e-a7f6-d6a6535254f4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:35.015209 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cfb26408-11ee-4d9e-a7f6-d6a6535254f4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:35.016486 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cfb26408-11ee-4d9e-a7f6-d6a6535254f4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:35.017093 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cfb26408-11ee-4d9e-a7f6-d6a6535254f4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:35.215535 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cfb26408-11ee-4d9e-a7f6-d6a6535254f4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:35.255539 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cfb26408-11ee-4d9e-a7f6-d6a6535254f4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:35.259656 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cfb26408-11ee-4d9e-a7f6-d6a6535254f4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:35.262047 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-cfb26408-11ee-4d9e-a7f6-d6a6535254f4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1723 microversion: 2.20 time: 0.260299 Aug 03 12:13:35.263642 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 134/280] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:35 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:13:35.289973 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d5524688-9c13-466f-8db6-eeec2f77402c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:35.298299 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d5524688-9c13-466f-8db6-eeec2f77402c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1507 microversion: 2.1 time: 0.363299 Aug 03 12:13:35.299484 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 147/281] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:34 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:36.293760 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-599e5cbc-767b-48f2-8d73-a72587e35728 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:36.295434 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-599e5cbc-767b-48f2-8d73-a72587e35728 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:36.308012 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-599e5cbc-767b-48f2-8d73-a72587e35728 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:36.309437 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-599e5cbc-767b-48f2-8d73-a72587e35728 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:36.311138 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-599e5cbc-767b-48f2-8d73-a72587e35728 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:36.311882 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-599e5cbc-767b-48f2-8d73-a72587e35728 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:36.327957 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a5da0ba5-877b-4079-9821-8a2a60e5c342 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:36.330817 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a5da0ba5-877b-4079-9821-8a2a60e5c342 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:36.354006 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a5da0ba5-877b-4079-9821-8a2a60e5c342 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:36.354503 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a5da0ba5-877b-4079-9821-8a2a60e5c342 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:36.359668 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a5da0ba5-877b-4079-9821-8a2a60e5c342 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:36.362025 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a5da0ba5-877b-4079-9821-8a2a60e5c342 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:36.626466 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-599e5cbc-767b-48f2-8d73-a72587e35728 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:36.658520 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-599e5cbc-767b-48f2-8d73-a72587e35728 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:36.669112 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-599e5cbc-767b-48f2-8d73-a72587e35728 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:36.678899 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-599e5cbc-767b-48f2-8d73-a72587e35728 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1723 microversion: 2.20 time: 0.393264 Aug 03 12:13:36.679495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 135/282] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:36 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1723 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:13:36.779829 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a5da0ba5-877b-4079-9821-8a2a60e5c342 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:36.787714 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a5da0ba5-877b-4079-9821-8a2a60e5c342 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1507 microversion: 2.1 time: 0.469791 Aug 03 12:13:36.788293 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 148/283] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:36 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:37.703956 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cd3cdf7a-486c-43ac-b3f3-0cde31f52ae8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:37.704569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-cd3cdf7a-486c-43ac-b3f3-0cde31f52ae8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:37.712006 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd3cdf7a-486c-43ac-b3f3-0cde31f52ae8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:37.712701 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd3cdf7a-486c-43ac-b3f3-0cde31f52ae8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:37.713687 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd3cdf7a-486c-43ac-b3f3-0cde31f52ae8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:37.714295 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd3cdf7a-486c-43ac-b3f3-0cde31f52ae8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:37.718807 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:37.815226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-443cdc58-d322-46d5-83fa-4c8f1917ea7c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:37.817260 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-443cdc58-d322-46d5-83fa-4c8f1917ea7c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:37.825036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-443cdc58-d322-46d5-83fa-4c8f1917ea7c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:37.825763 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-443cdc58-d322-46d5-83fa-4c8f1917ea7c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:37.826939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-443cdc58-d322-46d5-83fa-4c8f1917ea7c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:37.827406 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-443cdc58-d322-46d5-83fa-4c8f1917ea7c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:37.896810 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cd3cdf7a-486c-43ac-b3f3-0cde31f52ae8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:37.907021 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cd3cdf7a-486c-43ac-b3f3-0cde31f52ae8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:37.908927 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cd3cdf7a-486c-43ac-b3f3-0cde31f52ae8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:37.910330 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-cd3cdf7a-486c-43ac-b3f3-0cde31f52ae8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1723 microversion: 2.20 time: 0.210272 Aug 03 12:13:37.911594 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 136/284] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:37 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:13:38.012791 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-443cdc58-d322-46d5-83fa-4c8f1917ea7c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:38.020961 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-443cdc58-d322-46d5-83fa-4c8f1917ea7c tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1507 microversion: 2.1 time: 0.213414 Aug 03 12:13:38.026550 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 149/285] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:37 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:38.076706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6d87a569-162f-40e8-a27c-2e2a898223e7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Action: 'create', calling method: .version_select at 0x7f14dc3749d0>, body: {"keypair": {"name": "tempest-keypair-1515227677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETCbbsHnlN0UhbHqQq+Yt55/xO1ZTXB//zHjUD2R9uPQ1mMvjqXwmsfUT8W0/MBYOGn2tDCQeN+1uZIDuWF+Ym4T3eclTKvGBnCYSG8JNDKSkC/2HuVF5rBN74FOsh+hg=="}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:38.094713 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-6d87a569-162f-40e8-a27c-2e2a898223e7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'key_pairs'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:13:38.099387 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-6d87a569-162f-40e8-a27c-2e2a898223e7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for user e7566583228946488bd1ab647bbe8059 and project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'key_pairs'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:13:38.123794 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6d87a569-162f-40e8-a27c-2e2a898223e7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050969 Aug 03 12:13:38.124573 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 137/286] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 3 12:13:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:13:38.936099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e77a721e-3ffe-40d5-8ad4-f28ebd60c501 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:38.937386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e77a721e-3ffe-40d5-8ad4-f28ebd60c501 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:38.944640 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e77a721e-3ffe-40d5-8ad4-f28ebd60c501 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:38.945167 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e77a721e-3ffe-40d5-8ad4-f28ebd60c501 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:38.946563 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e77a721e-3ffe-40d5-8ad4-f28ebd60c501 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:38.947014 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e77a721e-3ffe-40d5-8ad4-f28ebd60c501 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:39.043359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f9b70458-a4c4-4bcf-b819-b57ab32b4e50 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:39.044807 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f9b70458-a4c4-4bcf-b819-b57ab32b4e50 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:39.059602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f9b70458-a4c4-4bcf-b819-b57ab32b4e50 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:39.060224 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f9b70458-a4c4-4bcf-b819-b57ab32b4e50 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:39.061196 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f9b70458-a4c4-4bcf-b819-b57ab32b4e50 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:39.061517 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f9b70458-a4c4-4bcf-b819-b57ab32b4e50 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:39.148122 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e77a721e-3ffe-40d5-8ad4-f28ebd60c501 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:39.160235 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e77a721e-3ffe-40d5-8ad4-f28ebd60c501 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:39.164387 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e77a721e-3ffe-40d5-8ad4-f28ebd60c501 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:39.166078 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e77a721e-3ffe-40d5-8ad4-f28ebd60c501 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1723 microversion: 2.20 time: 0.234453 Aug 03 12:13:39.167218 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 150/287] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:38 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:13:39.306427 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f9b70458-a4c4-4bcf-b819-b57ab32b4e50 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:39.326336 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f9b70458-a4c4-4bcf-b819-b57ab32b4e50 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1507 microversion: 2.1 time: 0.286918 Aug 03 12:13:39.339087 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 138/288] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:39 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:39.903885 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2015285820", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a64e775-73b7-4e56-9c06-9163d23fd664"}], "security_groups": [{"name": "tempest-securitygroup--710299415"}], "key_name": "tempest-keypair-1515227677", "user_data": "}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:40.192860 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ca2a2750-85c3-4070-95be-4692dc89c037 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:40.193362 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-ca2a2750-85c3-4070-95be-4692dc89c037 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:40.201002 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ca2a2750-85c3-4070-95be-4692dc89c037 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:40.201880 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ca2a2750-85c3-4070-95be-4692dc89c037 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:40.202911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ca2a2750-85c3-4070-95be-4692dc89c037 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:40.203412 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ca2a2750-85c3-4070-95be-4692dc89c037 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:40.365742 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ca2a2750-85c3-4070-95be-4692dc89c037 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:40.382023 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ca2a2750-85c3-4070-95be-4692dc89c037 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:40.385081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ca2a2750-85c3-4070-95be-4692dc89c037 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:40.386829 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ca2a2750-85c3-4070-95be-4692dc89c037 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1723 microversion: 2.20 time: 0.198068 Aug 03 12:13:40.388112 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 139/289] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:40 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:13:40.393805 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ed2d1b8f-a4c7-4041-a44c-94ae39f18212 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:40.394595 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-ed2d1b8f-a4c7-4041-a44c-94ae39f18212 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:40.402686 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ed2d1b8f-a4c7-4041-a44c-94ae39f18212 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:40.403512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ed2d1b8f-a4c7-4041-a44c-94ae39f18212 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:40.404512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ed2d1b8f-a4c7-4041-a44c-94ae39f18212 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:40.405115 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ed2d1b8f-a4c7-4041-a44c-94ae39f18212 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:40.581363 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ed2d1b8f-a4c7-4041-a44c-94ae39f18212 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:40.591973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ed2d1b8f-a4c7-4041-a44c-94ae39f18212 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1513 microversion: 2.1 time: 0.202314 Aug 03 12:13:40.593119 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 140/290] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:40 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:41.413448 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-dcf65492-3c74-4560-a22c-adc37b8da14e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:41.414125 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-dcf65492-3c74-4560-a22c-adc37b8da14e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:41.421011 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcf65492-3c74-4560-a22c-adc37b8da14e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:41.421795 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcf65492-3c74-4560-a22c-adc37b8da14e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:41.422805 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcf65492-3c74-4560-a22c-adc37b8da14e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:41.423427 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcf65492-3c74-4560-a22c-adc37b8da14e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:41.596539 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dcf65492-3c74-4560-a22c-adc37b8da14e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:41.607106 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dcf65492-3c74-4560-a22c-adc37b8da14e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:41.609048 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dcf65492-3c74-4560-a22c-adc37b8da14e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:41.610234 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-dcf65492-3c74-4560-a22c-adc37b8da14e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1723 microversion: 2.20 time: 0.201911 Aug 03 12:13:41.611009 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 141/291] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:41 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:13:42.062183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-948a8c5f-f8cf-4520-bf06-69952c75c2da tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Action: 'create', calling method: .version_select at 0x7f14dc270700>, body: {"keypair": {"name": "tempest-keypair-1732403474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9aJAUuzLJJmHlAJHF9jVDRNEBUJg5QCmpqnzKPqKGtnHGsSmbA6H03Oc81RJLckBW+nu1K2Ixu5W7nyCDRUOQje0ZgCf61hDmNTtkCZeq9KPdW7sgYLaaPFb6hZUh7ww=="}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:42.078207 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-948a8c5f-f8cf-4520-bf06-69952c75c2da tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Getting quotas for project d51be67fb4974085b55f3dcfcc2c70aa. Resources: {'key_pairs'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:13:42.088734 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-948a8c5f-f8cf-4520-bf06-69952c75c2da tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Getting quotas for user cde9db32ba1c4810833f8fd824536347 and project d51be67fb4974085b55f3dcfcc2c70aa. Resources: {'key_pairs'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:13:42.112448 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-948a8c5f-f8cf-4520-bf06-69952c75c2da tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054033 Aug 03 12:13:42.113065 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 142/292] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 3 12:13:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:13:42.635929 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0f8a4d13-6181-4f6e-9585-0651f1dd7391 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:42.636631 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-0f8a4d13-6181-4f6e-9585-0651f1dd7391 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:42.643510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0f8a4d13-6181-4f6e-9585-0651f1dd7391 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:42.643960 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0f8a4d13-6181-4f6e-9585-0651f1dd7391 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:42.644732 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0f8a4d13-6181-4f6e-9585-0651f1dd7391 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:42.645172 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0f8a4d13-6181-4f6e-9585-0651f1dd7391 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:42.869217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-0f8a4d13-6181-4f6e-9585-0651f1dd7391 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:42.882251 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-0f8a4d13-6181-4f6e-9585-0651f1dd7391 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:42.885236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-0f8a4d13-6181-4f6e-9585-0651f1dd7391 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:42.887055 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-0f8a4d13-6181-4f6e-9585-0651f1dd7391 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1723 microversion: 2.20 time: 0.255479 Aug 03 12:13:42.887835 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 143/293] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:42 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:13:43.892967 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-250814277", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7338a33-290c-4a93-9bd8-57cfb66ce3d7"}], "security_groups": [{"name": "tempest-securitygroup--1432040729"}], "key_name": "tempest-keypair-1732403474", "user_data": "}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:43.908435 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:47.375415 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] validate_networks() for [('5a64e775-73b7-4e56-9c06-9163d23fd664', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:13:47.425023 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.network.neutron [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] validate_networks() for [('b7338a33-290c-4a93-9bd8-57cfb66ce3d7', None, None, None, None, None)] {{(pid=117911) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:13:47.627527 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:47.975806 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:13:47.977753 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:13:47.978968 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:13:47.979951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:13:47.981037 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:13:48.005957 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:48.007151 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:48.008881 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:48.015201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:48.031500 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Flavor limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:13:48.032542 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Image limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:13:48.033868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Flavor pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:13:48.035547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Image pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:13:48.036547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:13:48.051677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:48.052414 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:48.053547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:48.054679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:48.057497 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:13:48.063065 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for user e7566583228946488bd1ab647bbe8059 and project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:13:48.080322 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:13:48.083008 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:13:48.084935 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Getting quotas for project d51be67fb4974085b55f3dcfcc2c70aa. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:13:48.094883 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Getting quotas for user cde9db32ba1c4810833f8fd824536347 and project d51be67fb4974085b55f3dcfcc2c70aa. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:13:48.125741 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Going to run 1 instances... {{(pid=117911) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:13:48.133105 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:13:48.163655 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5e660da9-c8f4-4513-b5d9-86ca63d045b3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 8.264698 Aug 03 12:13:48.182788 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 151/294] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:13:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 8285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:13:48.201754 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3dc3b15b-8630-4b51-b3c7-f050a124a161 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:48.207914 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3dc3b15b-8630-4b51-b3c7-f050a124a161 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:48.243041 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3dc3b15b-8630-4b51-b3c7-f050a124a161 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:48.243378 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3dc3b15b-8630-4b51-b3c7-f050a124a161 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:48.244162 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3dc3b15b-8630-4b51-b3c7-f050a124a161 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:48.244598 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3dc3b15b-8630-4b51-b3c7-f050a124a161 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:48.248993 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-96a246dc-fe7d-41cb-aec3-11d657a59bae tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.358691 Aug 03 12:13:48.252305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 144/295] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:13:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 4364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 12:13:48.281632 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-063d2c89-e403-4e3f-88e8-a7b6bf6b9845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:48.282907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-063d2c89-e403-4e3f-88e8-a7b6bf6b9845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:48.447197 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-063d2c89-e403-4e3f-88e8-a7b6bf6b9845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:48.463105 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-063d2c89-e403-4e3f-88e8-a7b6bf6b9845 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1242 microversion: 2.1 time: 0.206764 Aug 03 12:13:48.464143 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 145/296] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:48 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1242 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:48.494317 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-58d3f7b3-7b16-46e6-82ff-5bbb5190c879 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:48.495003 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-58d3f7b3-7b16-46e6-82ff-5bbb5190c879 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:48.687749 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-58d3f7b3-7b16-46e6-82ff-5bbb5190c879 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:48.689480 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3dc3b15b-8630-4b51-b3c7-f050a124a161 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:48.730188 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3dc3b15b-8630-4b51-b3c7-f050a124a161 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:48.731183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-58d3f7b3-7b16-46e6-82ff-5bbb5190c879 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1245 microversion: 2.1 time: 0.265771 Aug 03 12:13:48.733474 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3dc3b15b-8630-4b51-b3c7-f050a124a161 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:48.734338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 146/297] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:48 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1245 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:48.737038 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3dc3b15b-8630-4b51-b3c7-f050a124a161 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1744 microversion: 2.20 time: 0.551408 Aug 03 12:13:48.751631 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 152/298] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:48 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1744 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:13:49.492178 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-dd33fdcd-89ce-421c-b873-02cff81c6245 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:49.492805 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-dd33fdcd-89ce-421c-b873-02cff81c6245 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:49.501951 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dd33fdcd-89ce-421c-b873-02cff81c6245 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:49.502678 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dd33fdcd-89ce-421c-b873-02cff81c6245 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:49.503917 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dd33fdcd-89ce-421c-b873-02cff81c6245 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:49.504483 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dd33fdcd-89ce-421c-b873-02cff81c6245 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:49.594008 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dd33fdcd-89ce-421c-b873-02cff81c6245 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:49.617215 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-dd33fdcd-89ce-421c-b873-02cff81c6245 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1294 microversion: 2.1 time: 0.132409 Aug 03 12:13:49.617809 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 147/299] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:49 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1294 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:49.755854 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6f11618b-4a91-49c9-b17a-8400d60f47fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:49.757236 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6f11618b-4a91-49c9-b17a-8400d60f47fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:49.763719 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-603bdce5-f575-4bd3-a235-55cbe38353da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:49.764289 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f11618b-4a91-49c9-b17a-8400d60f47fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:49.764756 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f11618b-4a91-49c9-b17a-8400d60f47fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:49.765191 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-603bdce5-f575-4bd3-a235-55cbe38353da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:49.765731 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f11618b-4a91-49c9-b17a-8400d60f47fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:49.766170 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6f11618b-4a91-49c9-b17a-8400d60f47fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:49.772940 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-603bdce5-f575-4bd3-a235-55cbe38353da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:49.773991 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-603bdce5-f575-4bd3-a235-55cbe38353da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:49.774881 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-603bdce5-f575-4bd3-a235-55cbe38353da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:49.775890 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-603bdce5-f575-4bd3-a235-55cbe38353da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:49.848179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6f11618b-4a91-49c9-b17a-8400d60f47fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:49.856168 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6f11618b-4a91-49c9-b17a-8400d60f47fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1297 microversion: 2.1 time: 0.104234 Aug 03 12:13:49.856901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 153/300] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:49 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:13:49.935577 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-603bdce5-f575-4bd3-a235-55cbe38353da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:49.944232 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-603bdce5-f575-4bd3-a235-55cbe38353da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:49.946247 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-603bdce5-f575-4bd3-a235-55cbe38353da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:49.954137 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-603bdce5-f575-4bd3-a235-55cbe38353da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.194133 Aug 03 12:13:49.954755 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 148/301] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:49 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:13:50.637999 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c34fc060-b498-4d88-82ab-912a3e8fee4d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:50.638754 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c34fc060-b498-4d88-82ab-912a3e8fee4d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:50.649819 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c34fc060-b498-4d88-82ab-912a3e8fee4d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:50.650265 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c34fc060-b498-4d88-82ab-912a3e8fee4d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:50.651208 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c34fc060-b498-4d88-82ab-912a3e8fee4d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:50.651668 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c34fc060-b498-4d88-82ab-912a3e8fee4d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:50.729014 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c34fc060-b498-4d88-82ab-912a3e8fee4d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:50.738368 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c34fc060-b498-4d88-82ab-912a3e8fee4d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1300 microversion: 2.1 time: 0.104047 Aug 03 12:13:50.740605 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 154/302] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:50 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:50.882428 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6a9aaa6f-f1d9-41bf-a762-5fb67df62e78 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:50.884904 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-6a9aaa6f-f1d9-41bf-a762-5fb67df62e78 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:50.907102 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6a9aaa6f-f1d9-41bf-a762-5fb67df62e78 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:50.908167 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6a9aaa6f-f1d9-41bf-a762-5fb67df62e78 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:50.916657 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6a9aaa6f-f1d9-41bf-a762-5fb67df62e78 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:50.917691 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6a9aaa6f-f1d9-41bf-a762-5fb67df62e78 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:50.980143 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ad187c91-a5ed-4076-b73c-4057453cbccd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:50.980747 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ad187c91-a5ed-4076-b73c-4057453cbccd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:51.002274 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ad187c91-a5ed-4076-b73c-4057453cbccd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:51.003057 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ad187c91-a5ed-4076-b73c-4057453cbccd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:51.004029 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ad187c91-a5ed-4076-b73c-4057453cbccd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:51.004615 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ad187c91-a5ed-4076-b73c-4057453cbccd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:51.265902 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-6a9aaa6f-f1d9-41bf-a762-5fb67df62e78 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:51.280449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6a9aaa6f-f1d9-41bf-a762-5fb67df62e78 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1303 microversion: 2.1 time: 0.404674 Aug 03 12:13:51.282959 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 149/303] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:50 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1303 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:51.348334 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ad187c91-a5ed-4076-b73c-4057453cbccd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:51.357465 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ad187c91-a5ed-4076-b73c-4057453cbccd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:51.369327 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ad187c91-a5ed-4076-b73c-4057453cbccd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:51.370707 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ad187c91-a5ed-4076-b73c-4057453cbccd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.395032 Aug 03 12:13:51.382855 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 155/304] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:50 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:13:51.532221 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-01e722af-7e37-4c22-9764-b732826f7afd req-b0f92f96-c644-4992-8181-e2a55a9f6477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afb38cd-ec9c-4509-b7c8-91b170684ec5", "name": "network-vif-plugged", "status": "completed", "tag": "8f2969cf-b117-4fef-a2f6-5587992eefda"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:51.551996 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-01e722af-7e37-4c22-9764-b732826f7afd req-b0f92f96-c644-4992-8181-e2a55a9f6477 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:51.553747 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-01e722af-7e37-4c22-9764-b732826f7afd req-b0f92f96-c644-4992-8181-e2a55a9f6477 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:51.586354 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-01e722af-7e37-4c22-9764-b732826f7afd req-b0f92f96-c644-4992-8181-e2a55a9f6477 service nova] Creating event network-vif-plugged:8f2969cf-b117-4fef-a2f6-5587992eefda for instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 on hv-cinder-83602 Aug 03 12:13:51.600053 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-01e722af-7e37-4c22-9764-b732826f7afd req-b0f92f96-c644-4992-8181-e2a55a9f6477 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071277 Aug 03 12:13:51.603029 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 150/305] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:13:51.763838 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ac543ec8-03f8-4f42-adc9-3ef2eeb4663c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:51.764751 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ac543ec8-03f8-4f42-adc9-3ef2eeb4663c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:51.772637 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ac543ec8-03f8-4f42-adc9-3ef2eeb4663c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:51.773457 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ac543ec8-03f8-4f42-adc9-3ef2eeb4663c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:51.774874 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ac543ec8-03f8-4f42-adc9-3ef2eeb4663c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:51.775515 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ac543ec8-03f8-4f42-adc9-3ef2eeb4663c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:51.870991 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ac543ec8-03f8-4f42-adc9-3ef2eeb4663c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:51.880047 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ac543ec8-03f8-4f42-adc9-3ef2eeb4663c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1300 microversion: 2.1 time: 0.120569 Aug 03 12:13:51.880884 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 156/306] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:51 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:52.310778 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-afbedfd5-ac28-4bad-857e-2bb0ad119a7d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:52.311506 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-afbedfd5-ac28-4bad-857e-2bb0ad119a7d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:52.345144 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-afbedfd5-ac28-4bad-857e-2bb0ad119a7d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:52.345965 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-afbedfd5-ac28-4bad-857e-2bb0ad119a7d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:52.347930 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-afbedfd5-ac28-4bad-857e-2bb0ad119a7d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:52.348596 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-afbedfd5-ac28-4bad-857e-2bb0ad119a7d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:52.398833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a82781fa-ed27-4ba4-8412-27840254f186 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:52.399956 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a82781fa-ed27-4ba4-8412-27840254f186 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:52.407538 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a82781fa-ed27-4ba4-8412-27840254f186 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:52.408571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a82781fa-ed27-4ba4-8412-27840254f186 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:52.416164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a82781fa-ed27-4ba4-8412-27840254f186 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:52.416906 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a82781fa-ed27-4ba4-8412-27840254f186 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:52.963751 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a82781fa-ed27-4ba4-8412-27840254f186 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:52.984100 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a82781fa-ed27-4ba4-8412-27840254f186 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:52.985695 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a82781fa-ed27-4ba4-8412-27840254f186 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:52.989556 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a82781fa-ed27-4ba4-8412-27840254f186 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.596272 Aug 03 12:13:53.008544 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 157/307] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:52 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:13:53.013544 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8df6e3cf-6650-491f-9fbf-49908a6b026c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:53.014174 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8df6e3cf-6650-491f-9fbf-49908a6b026c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:53.037577 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8df6e3cf-6650-491f-9fbf-49908a6b026c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:53.038255 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8df6e3cf-6650-491f-9fbf-49908a6b026c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:53.039691 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8df6e3cf-6650-491f-9fbf-49908a6b026c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:53.052195 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8df6e3cf-6650-491f-9fbf-49908a6b026c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:53.097783 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-afbedfd5-ac28-4bad-857e-2bb0ad119a7d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:53.107865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-afbedfd5-ac28-4bad-857e-2bb0ad119a7d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.802403 Aug 03 12:13:53.108692 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 151/308] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:52 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:53.427303 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8df6e3cf-6650-491f-9fbf-49908a6b026c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:53.436095 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8df6e3cf-6650-491f-9fbf-49908a6b026c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1367 microversion: 2.1 time: 0.426332 Aug 03 12:13:53.439090 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 158/309] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:53 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1367 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:54.024867 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1942cbde-691c-4cf7-bd47-b908ce8d30cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:54.026311 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1942cbde-691c-4cf7-bd47-b908ce8d30cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:54.036758 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1942cbde-691c-4cf7-bd47-b908ce8d30cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:54.049281 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1942cbde-691c-4cf7-bd47-b908ce8d30cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:54.050672 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1942cbde-691c-4cf7-bd47-b908ce8d30cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:54.051331 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1942cbde-691c-4cf7-bd47-b908ce8d30cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:54.129979 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bbe71c7b-1665-4a8d-a300-0b9a0c21b106 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:54.130916 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bbe71c7b-1665-4a8d-a300-0b9a0c21b106 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:54.163325 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bbe71c7b-1665-4a8d-a300-0b9a0c21b106 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:54.169565 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bbe71c7b-1665-4a8d-a300-0b9a0c21b106 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:54.179765 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bbe71c7b-1665-4a8d-a300-0b9a0c21b106 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:54.186756 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bbe71c7b-1665-4a8d-a300-0b9a0c21b106 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:54.495526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bbe71c7b-1665-4a8d-a300-0b9a0c21b106 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:54.506458 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bbe71c7b-1665-4a8d-a300-0b9a0c21b106 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.380705 Aug 03 12:13:54.517426 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 159/310] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:54 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:13:54.530084 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a4476c7a-eb90-4fc8-bb95-2a10b0b9f0ad tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:54.531046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a4476c7a-eb90-4fc8-bb95-2a10b0b9f0ad tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:54.548714 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a4476c7a-eb90-4fc8-bb95-2a10b0b9f0ad tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:54.549167 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a4476c7a-eb90-4fc8-bb95-2a10b0b9f0ad tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:54.557666 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a4476c7a-eb90-4fc8-bb95-2a10b0b9f0ad tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:54.558116 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a4476c7a-eb90-4fc8-bb95-2a10b0b9f0ad tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:54.758838 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1942cbde-691c-4cf7-bd47-b908ce8d30cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:54.771368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1942cbde-691c-4cf7-bd47-b908ce8d30cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:54.775840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1942cbde-691c-4cf7-bd47-b908ce8d30cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:54.787178 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1942cbde-691c-4cf7-bd47-b908ce8d30cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.757227 Aug 03 12:13:54.788429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 152/311] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:54 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:13:54.838420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a4476c7a-eb90-4fc8-bb95-2a10b0b9f0ad tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:54.850547 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a4476c7a-eb90-4fc8-bb95-2a10b0b9f0ad tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1367 microversion: 2.1 time: 0.332063 Aug 03 12:13:54.851267 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 160/312] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:54 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:54.941012 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-9890443a-3b3c-4063-a80b-ca4912ba4d26 req-44c9d8c5-c3b2-43a2-b85e-0682383b478e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b98bd00-4a41-43d7-a5c6-ff4644582d13", "tag": "2946f3bb-8068-403a-8fc7-8e8c09e8d7c8"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:54.957040 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-9890443a-3b3c-4063-a80b-ca4912ba4d26 req-44c9d8c5-c3b2-43a2-b85e-0682383b478e service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:54.957804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-9890443a-3b3c-4063-a80b-ca4912ba4d26 req-44c9d8c5-c3b2-43a2-b85e-0682383b478e service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:54.971298 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-9890443a-3b3c-4063-a80b-ca4912ba4d26 req-44c9d8c5-c3b2-43a2-b85e-0682383b478e service nova] Creating event network-changed:2946f3bb-8068-403a-8fc7-8e8c09e8d7c8 for instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 on hv-cinder-83602 Aug 03 12:13:54.977086 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-9890443a-3b3c-4063-a80b-ca4912ba4d26 req-44c9d8c5-c3b2-43a2-b85e-0682383b478e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039982 Aug 03 12:13:54.978182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 153/313] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:13:55.029100 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f1feeb9a-c17a-4037-8dad-6da348c5e23c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Action: 'create', calling method: .version_select at 0x7f14dc3d5040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1378938440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3g48AVYNfX0wmXOz8gAdGNRaAViXY5g5lwbPkVuL/rNtJ6u1rBUYC4pS/U9r+uHOIbuwEjRhjq5AMx8iJ8YkYycg5oRo85SLzfQhQaY0JsT67DiBgXhJTE8KK28yVqaw=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:55.066199 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-f1feeb9a-c17a-4037-8dad-6da348c5e23c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Getting quotas for project 3156a99cf94e4845b22550fe2e064849. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:13:55.073920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-f1feeb9a-c17a-4037-8dad-6da348c5e23c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Getting quotas for user 55d69ed62c5742d28c1f06175a02e17f and project 3156a99cf94e4845b22550fe2e064849. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:13:55.100706 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f1feeb9a-c17a-4037-8dad-6da348c5e23c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.086474 Aug 03 12:13:55.113414 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 161/314] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 3 12:13:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:13:55.174403 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1035071448", "imageRef": "22424263-98d5-4ef9-8bfd-ee134fc57325", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1378938440", "networks": [{"uuid": "d29a4385-a1a5-48f9-b608-e0b8474485f5"}]}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:55.254699 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.network.neutron [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] validate_networks() for [('d29a4385-a1a5-48f9-b608-e0b8474485f5', None, None, None, None, None)] {{(pid=117911) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:13:55.535756 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8610900f-a5fc-4635-a1f1-16eebec47c36 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:55.538138 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8610900f-a5fc-4635-a1f1-16eebec47c36 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:55.553374 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8610900f-a5fc-4635-a1f1-16eebec47c36 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:55.554152 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8610900f-a5fc-4635-a1f1-16eebec47c36 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:55.555287 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8610900f-a5fc-4635-a1f1-16eebec47c36 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:55.555934 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8610900f-a5fc-4635-a1f1-16eebec47c36 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:56.009236 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8610900f-a5fc-4635-a1f1-16eebec47c36 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:56.019776 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8610900f-a5fc-4635-a1f1-16eebec47c36 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.488659 Aug 03 12:13:56.037941 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 162/315] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:55 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:56.049993 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-857d9994-748f-4164-9174-4f78d2127727 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:56.051920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-857d9994-748f-4164-9174-4f78d2127727 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:56.066959 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-857d9994-748f-4164-9174-4f78d2127727 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:56.068480 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-857d9994-748f-4164-9174-4f78d2127727 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:56.072648 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-857d9994-748f-4164-9174-4f78d2127727 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:56.073525 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-857d9994-748f-4164-9174-4f78d2127727 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:56.379823 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Flavor limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:13:56.380325 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Image limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:13:56.383210 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Flavor pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:13:56.383710 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Image pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:13:56.384141 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:13:56.413398 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:56.413810 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:56.414641 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:56.416586 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:56.433164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-857d9994-748f-4164-9174-4f78d2127727 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:56.448509 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Getting quotas for project 3156a99cf94e4845b22550fe2e064849. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:13:56.454258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-857d9994-748f-4164-9174-4f78d2127727 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:56.457120 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Getting quotas for user 55d69ed62c5742d28c1f06175a02e17f and project 3156a99cf94e4845b22550fe2e064849. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:13:56.458609 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-857d9994-748f-4164-9174-4f78d2127727 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:56.465297 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-857d9994-748f-4164-9174-4f78d2127727 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.420505 Aug 03 12:13:56.466223 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 163/316] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:56 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:13:56.473923 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b5d356b5-f6ed-47bd-afb6-6df88511f3e5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:56.474328 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Going to run 1 instances... {{(pid=117911) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:13:56.474851 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b5d356b5-f6ed-47bd-afb6-6df88511f3e5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:56.482513 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22424263-98d5-4ef9-8bfd-ee134fc57325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:13:56.487616 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b5d356b5-f6ed-47bd-afb6-6df88511f3e5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:56.488067 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b5d356b5-f6ed-47bd-afb6-6df88511f3e5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:56.489693 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b5d356b5-f6ed-47bd-afb6-6df88511f3e5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:56.490368 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b5d356b5-f6ed-47bd-afb6-6df88511f3e5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:56.520919 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:56.556118 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b4a784c8-90c4-4605-84c1-ef190e9b3e36 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.388313 Aug 03 12:13:56.560961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 154/317] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:13:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:13:56.574179 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1283953683", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1695578460", "security_groups": [{"name": "tempest-secgroup-smoke-1652712651"}], "block_device_mapping_v2": [{"uuid": "b9787886-4451-4c89-99b6-8822a819e961", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a7bb6085-454f-4cb3-bcae-1c152bc4a607"}]}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:56.737082 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b5d356b5-f6ed-47bd-afb6-6df88511f3e5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:56.747547 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b5d356b5-f6ed-47bd-afb6-6df88511f3e5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1367 microversion: 2.1 time: 0.280012 Aug 03 12:13:56.752096 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 164/318] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:56 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:56.757350 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f8bb145f-245c-4941-8b73-35f44f996be0 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:56.758209 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f8bb145f-245c-4941-8b73-35f44f996be0 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:56.877023 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.network.neutron [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] validate_networks() for [('a7bb6085-454f-4cb3-bcae-1c152bc4a607', None, None, None, None, None)] {{(pid=117911) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:13:56.888159 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f8bb145f-245c-4941-8b73-35f44f996be0 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:56.910779 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f8bb145f-245c-4941-8b73-35f44f996be0 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1259 microversion: 2.1 time: 0.157341 Aug 03 12:13:56.926854 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 165/319] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:56 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:57.020444 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-7021f452-024e-4614-a7d6-e64bd97a9b2e req-5f4503f5-7b32-4f12-a1a2-4f44650c76df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2776d6e3-3b32-4548-828f-cc640cc445bf", "tag": "d073cee3-622e-495d-87b3-79a9d0c5308a"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:13:57.038128 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-7021f452-024e-4614-a7d6-e64bd97a9b2e req-5f4503f5-7b32-4f12-a1a2-4f44650c76df service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:57.039973 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-7021f452-024e-4614-a7d6-e64bd97a9b2e req-5f4503f5-7b32-4f12-a1a2-4f44650c76df service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:57.056721 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-7021f452-024e-4614-a7d6-e64bd97a9b2e req-5f4503f5-7b32-4f12-a1a2-4f44650c76df service nova] Creating event network-changed:d073cee3-622e-495d-87b3-79a9d0c5308a for instance 2776d6e3-3b32-4548-828f-cc640cc445bf on hv-cinder-83602 Aug 03 12:13:57.068344 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-7021f452-024e-4614-a7d6-e64bd97a9b2e req-5f4503f5-7b32-4f12-a1a2-4f44650c76df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058577 Aug 03 12:13:57.080500 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 166/320] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:13:57.093167 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bfcec6fa-0792-453f-b20b-18d1bec4761f tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:57.095483 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bfcec6fa-0792-453f-b20b-18d1bec4761f tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:57.113047 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bfcec6fa-0792-453f-b20b-18d1bec4761f tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:57.115266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bfcec6fa-0792-453f-b20b-18d1bec4761f tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:57.116212 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bfcec6fa-0792-453f-b20b-18d1bec4761f tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:57.116717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bfcec6fa-0792-453f-b20b-18d1bec4761f tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:57.398894 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bfcec6fa-0792-453f-b20b-18d1bec4761f tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:57.409805 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bfcec6fa-0792-453f-b20b-18d1bec4761f tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.327650 Aug 03 12:13:57.411228 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 167/321] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:57 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:57.495121 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cb08d8e8-c70e-441d-ba28-915c2bf08329 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:57.496455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cb08d8e8-c70e-441d-ba28-915c2bf08329 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:57.508277 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cb08d8e8-c70e-441d-ba28-915c2bf08329 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:57.508737 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cb08d8e8-c70e-441d-ba28-915c2bf08329 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:57.509553 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cb08d8e8-c70e-441d-ba28-915c2bf08329 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:57.510054 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cb08d8e8-c70e-441d-ba28-915c2bf08329 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:57.777685 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cb08d8e8-c70e-441d-ba28-915c2bf08329 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:57.792894 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cb08d8e8-c70e-441d-ba28-915c2bf08329 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:57.794994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cb08d8e8-c70e-441d-ba28-915c2bf08329 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:57.797646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cb08d8e8-c70e-441d-ba28-915c2bf08329 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.307502 Aug 03 12:13:57.798513 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 168/322] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:57 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:13:57.805047 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a11080f8-048e-4e28-a8d3-3e0e5b46764e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:57.806068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a11080f8-048e-4e28-a8d3-3e0e5b46764e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:57.812865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a11080f8-048e-4e28-a8d3-3e0e5b46764e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:57.813317 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a11080f8-048e-4e28-a8d3-3e0e5b46764e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:57.814103 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a11080f8-048e-4e28-a8d3-3e0e5b46764e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:57.815063 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a11080f8-048e-4e28-a8d3-3e0e5b46764e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:57.860044 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Flavor limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:13:57.860566 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Image limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:13:57.861134 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Flavor pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:13:57.861753 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Image pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:13:57.862401 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:13:57.874931 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:57.876386 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:57.877977 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:57.879091 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:57.904043 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Getting quotas for project 1a4c09dba5b24ef5b37b730b259d3790. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:13:57.909543 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Getting quotas for user 5cf524f6288040219c0492d3a794e830 and project 1a4c09dba5b24ef5b37b730b259d3790. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:13:57.980710 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Going to run 1 instances... {{(pid=117911) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:13:57.983092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9787886-4451-4c89-99b6-8822a819e961',volume_size=None,volume_type=None)] {{(pid=117911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:13:58.025629 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a11080f8-048e-4e28-a8d3-3e0e5b46764e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:58.034851 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a11080f8-048e-4e28-a8d3-3e0e5b46764e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1367 microversion: 2.1 time: 0.235061 Aug 03 12:13:58.035793 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 169/323] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:57 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:58.042138 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-955ccfd3-a6f2-497f-99fc-cb9533bffeae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:58.043205 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-955ccfd3-a6f2-497f-99fc-cb9533bffeae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:58.045473 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:13:58.051438 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-955ccfd3-a6f2-497f-99fc-cb9533bffeae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:58.052479 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-955ccfd3-a6f2-497f-99fc-cb9533bffeae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:58.053501 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-955ccfd3-a6f2-497f-99fc-cb9533bffeae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:58.054234 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-955ccfd3-a6f2-497f-99fc-cb9533bffeae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:58.128197 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-955ccfd3-a6f2-497f-99fc-cb9533bffeae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:58.138729 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-955ccfd3-a6f2-497f-99fc-cb9533bffeae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1263 microversion: 2.1 time: 0.101370 Aug 03 12:13:58.140042 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 170/324] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:58 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1263 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:58.176392 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-0a464aaf-3110-48eb-a0a4-e3323a53d447 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.611765 Aug 03 12:13:58.177695 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 155/325] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:13:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:13:58.192955 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7f896986-6370-4a2f-a66e-dcc502843633 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:58.193639 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7f896986-6370-4a2f-a66e-dcc502843633 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:58.263570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7f896986-6370-4a2f-a66e-dcc502843633 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:58.271166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7f896986-6370-4a2f-a66e-dcc502843633 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1095 microversion: 2.1 time: 0.082672 Aug 03 12:13:58.285880 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 171/326] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:58 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:58.431500 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d3f39b30-5602-471a-bd14-02e39590ae4a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:58.432494 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d3f39b30-5602-471a-bd14-02e39590ae4a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:58.442244 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d3f39b30-5602-471a-bd14-02e39590ae4a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:58.443126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d3f39b30-5602-471a-bd14-02e39590ae4a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:58.444457 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d3f39b30-5602-471a-bd14-02e39590ae4a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:58.445401 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d3f39b30-5602-471a-bd14-02e39590ae4a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:58.622212 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d3f39b30-5602-471a-bd14-02e39590ae4a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:58.631509 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d3f39b30-5602-471a-bd14-02e39590ae4a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.204217 Aug 03 12:13:58.633549 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 156/327] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:58 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:58.821864 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-58d13297-b658-4722-a86c-aa2f5774b4a4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:58.822654 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-58d13297-b658-4722-a86c-aa2f5774b4a4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:58.836573 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-58d13297-b658-4722-a86c-aa2f5774b4a4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:58.837222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-58d13297-b658-4722-a86c-aa2f5774b4a4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:58.838142 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-58d13297-b658-4722-a86c-aa2f5774b4a4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:58.842795 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-58d13297-b658-4722-a86c-aa2f5774b4a4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:59.083505 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-993432e2-381a-4006-ab24-9e642ee497ff tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:59.088445 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-993432e2-381a-4006-ab24-9e642ee497ff tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:59.125314 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-993432e2-381a-4006-ab24-9e642ee497ff tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:59.132523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-993432e2-381a-4006-ab24-9e642ee497ff tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:59.139176 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-993432e2-381a-4006-ab24-9e642ee497ff tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:59.140207 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-993432e2-381a-4006-ab24-9e642ee497ff tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:59.563929 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-58d13297-b658-4722-a86c-aa2f5774b4a4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:59.577645 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-58d13297-b658-4722-a86c-aa2f5774b4a4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:59.579802 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-58d13297-b658-4722-a86c-aa2f5774b4a4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:59.581358 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-58d13297-b658-4722-a86c-aa2f5774b4a4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.763900 Aug 03 12:13:59.596121 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 172/328] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:13:58 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:13:59.614116 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3a7765f1-6fc0-457d-b01a-cb32c19faca4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:59.615053 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3a7765f1-6fc0-457d-b01a-cb32c19faca4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:59.623193 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3a7765f1-6fc0-457d-b01a-cb32c19faca4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:59.623914 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3a7765f1-6fc0-457d-b01a-cb32c19faca4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:59.624919 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3a7765f1-6fc0-457d-b01a-cb32c19faca4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:59.625537 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3a7765f1-6fc0-457d-b01a-cb32c19faca4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:59.732813 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3a7765f1-6fc0-457d-b01a-cb32c19faca4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:59.744533 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3a7765f1-6fc0-457d-b01a-cb32c19faca4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1319 microversion: 2.1 time: 0.140349 Aug 03 12:13:59.745489 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 173/329] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:59 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:59.758758 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-17d3c1f2-5eea-4b97-8888-46d3bd815539 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:59.758758 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-17d3c1f2-5eea-4b97-8888-46d3bd815539 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:59.759597 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17d3c1f2-5eea-4b97-8888-46d3bd815539 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:59.760336 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17d3c1f2-5eea-4b97-8888-46d3bd815539 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:59.761345 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17d3c1f2-5eea-4b97-8888-46d3bd815539 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:59.761791 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17d3c1f2-5eea-4b97-8888-46d3bd815539 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:59.855353 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-17d3c1f2-5eea-4b97-8888-46d3bd815539 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:59.866168 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-17d3c1f2-5eea-4b97-8888-46d3bd815539 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1193 microversion: 2.1 time: 0.119442 Aug 03 12:13:59.887010 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 174/330] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:59 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1193 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:13:59.892316 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2a3b1aa5-39b3-4fa2-aae7-3c9b01636050 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:13:59.897614 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2a3b1aa5-39b3-4fa2-aae7-3c9b01636050 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:13:59.909856 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2a3b1aa5-39b3-4fa2-aae7-3c9b01636050 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:59.914554 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2a3b1aa5-39b3-4fa2-aae7-3c9b01636050 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:59.915720 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2a3b1aa5-39b3-4fa2-aae7-3c9b01636050 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:13:59.917066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2a3b1aa5-39b3-4fa2-aae7-3c9b01636050 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:13:59.956895 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-993432e2-381a-4006-ab24-9e642ee497ff tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:13:59.970946 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-993432e2-381a-4006-ab24-9e642ee497ff tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1367 microversion: 2.1 time: 0.910567 Aug 03 12:13:59.974342 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 157/331] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:59 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1367 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:00.375221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2a3b1aa5-39b3-4fa2-aae7-3c9b01636050 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:00.387974 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2a3b1aa5-39b3-4fa2-aae7-3c9b01636050 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.499424 Aug 03 12:14:00.393555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 175/332] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:13:59 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:00.613444 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f471378e-3966-43ce-8bcd-78b2983010b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:00.615150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f471378e-3966-43ce-8bcd-78b2983010b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:00.633673 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f471378e-3966-43ce-8bcd-78b2983010b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:00.635573 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f471378e-3966-43ce-8bcd-78b2983010b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:00.638010 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f471378e-3966-43ce-8bcd-78b2983010b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:00.638921 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f471378e-3966-43ce-8bcd-78b2983010b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:00.770961 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e54933a0-17d0-413e-92b2-78d6a84d2f6c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:00.772028 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e54933a0-17d0-413e-92b2-78d6a84d2f6c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:00.782596 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e54933a0-17d0-413e-92b2-78d6a84d2f6c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:00.784289 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e54933a0-17d0-413e-92b2-78d6a84d2f6c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:00.787248 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e54933a0-17d0-413e-92b2-78d6a84d2f6c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:00.791009 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e54933a0-17d0-413e-92b2-78d6a84d2f6c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:01.006948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e54933a0-17d0-413e-92b2-78d6a84d2f6c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:01.015388 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e54933a0-17d0-413e-92b2-78d6a84d2f6c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1317 microversion: 2.1 time: 0.250203 Aug 03 12:14:01.015972 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 176/333] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:00 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:01.027091 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-29180f3c-766d-4a80-8e62-8e92e6fbc254 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:01.039712 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-29180f3c-766d-4a80-8e62-8e92e6fbc254 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:01.054649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29180f3c-766d-4a80-8e62-8e92e6fbc254 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:01.057671 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29180f3c-766d-4a80-8e62-8e92e6fbc254 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:01.058745 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29180f3c-766d-4a80-8e62-8e92e6fbc254 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:01.059191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29180f3c-766d-4a80-8e62-8e92e6fbc254 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:01.173966 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-29180f3c-766d-4a80-8e62-8e92e6fbc254 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:01.184535 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-29180f3c-766d-4a80-8e62-8e92e6fbc254 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1211 microversion: 2.1 time: 0.161062 Aug 03 12:14:01.198423 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 177/334] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:01 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1211 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:01.207511 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d9670825-fb07-4b2d-ab79-8282f1ca0b43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:01.208194 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d9670825-fb07-4b2d-ab79-8282f1ca0b43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:01.222528 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d9670825-fb07-4b2d-ab79-8282f1ca0b43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:01.224649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d9670825-fb07-4b2d-ab79-8282f1ca0b43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:01.225785 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d9670825-fb07-4b2d-ab79-8282f1ca0b43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:01.228180 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d9670825-fb07-4b2d-ab79-8282f1ca0b43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:01.260492 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f471378e-3966-43ce-8bcd-78b2983010b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:01.297068 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f471378e-3966-43ce-8bcd-78b2983010b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:01.308272 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f471378e-3966-43ce-8bcd-78b2983010b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:01.309711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f471378e-3966-43ce-8bcd-78b2983010b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.706183 Aug 03 12:14:01.312214 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 158/335] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:00 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:01.415476 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a85ceffa-9c22-4e77-92ba-2f06454f2393 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:01.417528 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a85ceffa-9c22-4e77-92ba-2f06454f2393 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:01.533492 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a85ceffa-9c22-4e77-92ba-2f06454f2393 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:01.534053 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a85ceffa-9c22-4e77-92ba-2f06454f2393 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:01.537471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a85ceffa-9c22-4e77-92ba-2f06454f2393 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:01.537922 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a85ceffa-9c22-4e77-92ba-2f06454f2393 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:01.735112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d9670825-fb07-4b2d-ab79-8282f1ca0b43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:01.751320 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d9670825-fb07-4b2d-ab79-8282f1ca0b43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1367 microversion: 2.1 time: 0.551548 Aug 03 12:14:01.752200 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 178/336] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:01 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1367 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:01.786839 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-47b61cf0-a646-4f06-bc21-5aebde7035d4 req-989369b8-982e-41ba-b896-2ecae2957eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2776d6e3-3b32-4548-828f-cc640cc445bf", "name": "network-vif-plugged", "status": "completed", "tag": "d073cee3-622e-495d-87b3-79a9d0c5308a"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:01.815655 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-47b61cf0-a646-4f06-bc21-5aebde7035d4 req-989369b8-982e-41ba-b896-2ecae2957eec service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:01.818271 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-47b61cf0-a646-4f06-bc21-5aebde7035d4 req-989369b8-982e-41ba-b896-2ecae2957eec service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:01.871743 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-47b61cf0-a646-4f06-bc21-5aebde7035d4 req-989369b8-982e-41ba-b896-2ecae2957eec service nova] Creating event network-vif-plugged:d073cee3-622e-495d-87b3-79a9d0c5308a for instance 2776d6e3-3b32-4548-828f-cc640cc445bf on hv-cinder-83602 Aug 03 12:14:01.892416 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-47b61cf0-a646-4f06-bc21-5aebde7035d4 req-989369b8-982e-41ba-b896-2ecae2957eec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109314 Aug 03 12:14:01.903611 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 179/337] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:02.040637 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-08f6126a-7f75-4dea-86ff-a9852b1c905b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:02.041652 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-08f6126a-7f75-4dea-86ff-a9852b1c905b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:02.066037 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-08f6126a-7f75-4dea-86ff-a9852b1c905b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:02.075161 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-08f6126a-7f75-4dea-86ff-a9852b1c905b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:02.082204 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-08f6126a-7f75-4dea-86ff-a9852b1c905b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:02.083458 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-08f6126a-7f75-4dea-86ff-a9852b1c905b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:02.579899 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-08f6126a-7f75-4dea-86ff-a9852b1c905b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:02.625661 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-08f6126a-7f75-4dea-86ff-a9852b1c905b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.591083 Aug 03 12:14:02.644691 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 180/338] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:02 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:02.657139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8a431e6d-d4d5-4eb7-9895-77240a7585ae tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:02.665940 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8a431e6d-d4d5-4eb7-9895-77240a7585ae tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:02.685994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8a431e6d-d4d5-4eb7-9895-77240a7585ae tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:02.686573 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8a431e6d-d4d5-4eb7-9895-77240a7585ae tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:02.687466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8a431e6d-d4d5-4eb7-9895-77240a7585ae tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:02.687911 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8a431e6d-d4d5-4eb7-9895-77240a7585ae tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:03.056940 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a85ceffa-9c22-4e77-92ba-2f06454f2393 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:03.067823 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a85ceffa-9c22-4e77-92ba-2f06454f2393 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 1.655778 Aug 03 12:14:03.078963 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 159/339] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:01 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:03.098294 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-86d31c3d-8a12-41cd-bad1-24e684400387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:03.101737 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-86d31c3d-8a12-41cd-bad1-24e684400387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:03.124953 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-86d31c3d-8a12-41cd-bad1-24e684400387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:03.128438 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-86d31c3d-8a12-41cd-bad1-24e684400387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:03.131229 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-86d31c3d-8a12-41cd-bad1-24e684400387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:03.135209 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-86d31c3d-8a12-41cd-bad1-24e684400387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:03.152043 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=100 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:03.221498 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8a431e6d-d4d5-4eb7-9895-77240a7585ae tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:03.233152 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8a431e6d-d4d5-4eb7-9895-77240a7585ae tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.586929 Aug 03 12:14:03.237578 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 181/340] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:02 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:03.258036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-419c4844-3c01-4a56-aac6-d9f69b0d044b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:03.260324 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-419c4844-3c01-4a56-aac6-d9f69b0d044b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:03.282863 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-419c4844-3c01-4a56-aac6-d9f69b0d044b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:03.283481 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-419c4844-3c01-4a56-aac6-d9f69b0d044b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:03.284392 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-419c4844-3c01-4a56-aac6-d9f69b0d044b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:03.290242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-419c4844-3c01-4a56-aac6-d9f69b0d044b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:03.715049 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-419c4844-3c01-4a56-aac6-d9f69b0d044b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:03.728509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-419c4844-3c01-4a56-aac6-d9f69b0d044b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1367 microversion: 2.1 time: 0.484782 Aug 03 12:14:03.731038 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 182/341] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:03 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:03.750364 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-45d37b7f-3d82-414c-a7b1-9b0b71d6768a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:03.754188 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-45d37b7f-3d82-414c-a7b1-9b0b71d6768a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:03.769334 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45d37b7f-3d82-414c-a7b1-9b0b71d6768a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:03.773964 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45d37b7f-3d82-414c-a7b1-9b0b71d6768a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:03.774905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45d37b7f-3d82-414c-a7b1-9b0b71d6768a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:03.775347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45d37b7f-3d82-414c-a7b1-9b0b71d6768a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:03.967598 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-86d31c3d-8a12-41cd-bad1-24e684400387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:03.992959 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-86d31c3d-8a12-41cd-bad1-24e684400387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:03.996711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-86d31c3d-8a12-41cd-bad1-24e684400387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:04.005739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-86d31c3d-8a12-41cd-bad1-24e684400387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.925463 Aug 03 12:14:04.011017 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 160/342] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:03 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:04.097748 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-18b45b47-9577-489a-b2e8-b8222edd33cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:04.099196 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-18b45b47-9577-489a-b2e8-b8222edd33cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:04.117224 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-18b45b47-9577-489a-b2e8-b8222edd33cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:04.125251 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-18b45b47-9577-489a-b2e8-b8222edd33cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:04.131358 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-18b45b47-9577-489a-b2e8-b8222edd33cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:04.131826 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-18b45b47-9577-489a-b2e8-b8222edd33cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:04.322128 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-45d37b7f-3d82-414c-a7b1-9b0b71d6768a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:04.330642 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-45d37b7f-3d82-414c-a7b1-9b0b71d6768a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.598184 Aug 03 12:14:04.331247 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 183/343] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:03 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:04.347147 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-e34f6e53-f76d-48cb-ab1d-2713248c7cb6 req-bd0ee4d2-afc4-43fe-be66-480671a929d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b98bd00-4a41-43d7-a5c6-ff4644582d13", "name": "network-vif-plugged", "status": "completed", "tag": "2946f3bb-8068-403a-8fc7-8e8c09e8d7c8"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:04.402969 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-e34f6e53-f76d-48cb-ab1d-2713248c7cb6 req-bd0ee4d2-afc4-43fe-be66-480671a929d6 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:04.413728 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-e34f6e53-f76d-48cb-ab1d-2713248c7cb6 req-bd0ee4d2-afc4-43fe-be66-480671a929d6 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:04.490468 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-e34f6e53-f76d-48cb-ab1d-2713248c7cb6 req-bd0ee4d2-afc4-43fe-be66-480671a929d6 service nova] Creating event network-vif-plugged:2946f3bb-8068-403a-8fc7-8e8c09e8d7c8 for instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 on hv-cinder-83602 Aug 03 12:14:04.587759 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-e34f6e53-f76d-48cb-ab1d-2713248c7cb6 req-bd0ee4d2-afc4-43fe-be66-480671a929d6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255117 Aug 03 12:14:04.589584 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 184/344] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:04.625761 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5c4ec4d8-5dd3-482c-8604-281220e46bf2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:04.628643 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5c4ec4d8-5dd3-482c-8604-281220e46bf2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:04.664855 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5c4ec4d8-5dd3-482c-8604-281220e46bf2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:04.670205 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5c4ec4d8-5dd3-482c-8604-281220e46bf2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:04.674698 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5c4ec4d8-5dd3-482c-8604-281220e46bf2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:04.676948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5c4ec4d8-5dd3-482c-8604-281220e46bf2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:04.704820 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:04.759401 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-18b45b47-9577-489a-b2e8-b8222edd33cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:04.779528 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-18b45b47-9577-489a-b2e8-b8222edd33cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.687842 Aug 03 12:14:04.780656 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 161/345] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:04 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:04.785669 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-dd0e4be7-3e2a-4041-83f0-0d2fa63e4319 req-154843b6-968a-4fd3-93fd-a80176824c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ef0b56c-b712-49ca-8847-a0acbc0a729a", "tag": "c2052327-4535-436a-9914-53604665eddd"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:04.819643 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-dd0e4be7-3e2a-4041-83f0-0d2fa63e4319 req-154843b6-968a-4fd3-93fd-a80176824c6a service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:04.820622 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-dd0e4be7-3e2a-4041-83f0-0d2fa63e4319 req-154843b6-968a-4fd3-93fd-a80176824c6a service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:04.836913 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-dd0e4be7-3e2a-4041-83f0-0d2fa63e4319 req-154843b6-968a-4fd3-93fd-a80176824c6a service nova] Creating event network-changed:c2052327-4535-436a-9914-53604665eddd for instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a on hv-cinder-83602 Aug 03 12:14:04.853147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-dd0e4be7-3e2a-4041-83f0-0d2fa63e4319 req-154843b6-968a-4fd3-93fd-a80176824c6a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070895 Aug 03 12:14:04.854480 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 162/346] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:04.860411 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-20115a0d-737b-4069-b0ec-234b4c7f15a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:04.861614 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-20115a0d-737b-4069-b0ec-234b4c7f15a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:04.884130 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-20115a0d-737b-4069-b0ec-234b4c7f15a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:04.885431 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-20115a0d-737b-4069-b0ec-234b4c7f15a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:04.886650 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-20115a0d-737b-4069-b0ec-234b4c7f15a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:04.887366 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-20115a0d-737b-4069-b0ec-234b4c7f15a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:05.140705 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5c4ec4d8-5dd3-482c-8604-281220e46bf2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:05.152886 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5c4ec4d8-5dd3-482c-8604-281220e46bf2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.561332 Aug 03 12:14:05.171428 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 185/347] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:04 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:05.178521 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-775ebda0-8a15-4302-bfa1-651c5c76105c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:05.181482 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-775ebda0-8a15-4302-bfa1-651c5c76105c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:05.199394 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-775ebda0-8a15-4302-bfa1-651c5c76105c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:05.199978 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-775ebda0-8a15-4302-bfa1-651c5c76105c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:05.200857 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-775ebda0-8a15-4302-bfa1-651c5c76105c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:05.201355 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-775ebda0-8a15-4302-bfa1-651c5c76105c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:05.580405 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-20115a0d-737b-4069-b0ec-234b4c7f15a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:05.606129 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-20115a0d-737b-4069-b0ec-234b4c7f15a1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1367 microversion: 2.1 time: 0.749957 Aug 03 12:14:05.606958 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 163/348] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:04 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1367 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:05.616048 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5cab82c9-bdcf-4292-96fc-24e57a835506 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:05.623460 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-775ebda0-8a15-4302-bfa1-651c5c76105c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:05.636524 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-775ebda0-8a15-4302-bfa1-651c5c76105c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:05.638110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-775ebda0-8a15-4302-bfa1-651c5c76105c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:05.638990 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5cab82c9-bdcf-4292-96fc-24e57a835506 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:05.648527 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-775ebda0-8a15-4302-bfa1-651c5c76105c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.471626 Aug 03 12:14:05.649674 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 186/349] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:05 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:05.649800 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5cab82c9-bdcf-4292-96fc-24e57a835506 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:05.650200 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5cab82c9-bdcf-4292-96fc-24e57a835506 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:05.651041 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5cab82c9-bdcf-4292-96fc-24e57a835506 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:05.651650 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5cab82c9-bdcf-4292-96fc-24e57a835506 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:05.801425 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4f2dc9b4-722a-4e09-8281-6821a4a87126 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:05.802341 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4f2dc9b4-722a-4e09-8281-6821a4a87126 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:05.805188 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:05.823466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f2dc9b4-722a-4e09-8281-6821a4a87126 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:05.824288 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f2dc9b4-722a-4e09-8281-6821a4a87126 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:05.825334 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f2dc9b4-722a-4e09-8281-6821a4a87126 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:05.826067 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f2dc9b4-722a-4e09-8281-6821a4a87126 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:06.101531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5cab82c9-bdcf-4292-96fc-24e57a835506 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:06.110238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5cab82c9-bdcf-4292-96fc-24e57a835506 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.502092 Aug 03 12:14:06.127128 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 164/350] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:05 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:06.167985 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4f2dc9b4-722a-4e09-8281-6821a4a87126 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:06.184561 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-339f3aaf-668e-40df-8180-5a65eaacbd1a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:06.185519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-339f3aaf-668e-40df-8180-5a65eaacbd1a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:06.190276 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4f2dc9b4-722a-4e09-8281-6821a4a87126 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.391698 Aug 03 12:14:06.192431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 187/351] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:05 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:06.212614 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-339f3aaf-668e-40df-8180-5a65eaacbd1a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:06.213491 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-339f3aaf-668e-40df-8180-5a65eaacbd1a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:06.214767 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-339f3aaf-668e-40df-8180-5a65eaacbd1a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:06.215638 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-339f3aaf-668e-40df-8180-5a65eaacbd1a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:06.414744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-0376016a-725e-49b1-b40f-2f33102d68e3 req-eb584bfd-76ba-4bd3-9cfb-62b9df68bc2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692c1c3e-e3b3-4d9a-ac59-e82611208c18", "tag": "543f3e50-e8ff-49c4-bc9f-a59da69e215e"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:06.436984 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-0376016a-725e-49b1-b40f-2f33102d68e3 req-eb584bfd-76ba-4bd3-9cfb-62b9df68bc2b service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:06.443360 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-0376016a-725e-49b1-b40f-2f33102d68e3 req-eb584bfd-76ba-4bd3-9cfb-62b9df68bc2b service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:06.471255 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-0376016a-725e-49b1-b40f-2f33102d68e3 req-eb584bfd-76ba-4bd3-9cfb-62b9df68bc2b service nova] Creating event network-changed:543f3e50-e8ff-49c4-bc9f-a59da69e215e for instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 on hv-cinder-83602 Aug 03 12:14:06.497161 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-0376016a-725e-49b1-b40f-2f33102d68e3 req-eb584bfd-76ba-4bd3-9cfb-62b9df68bc2b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086641 Aug 03 12:14:06.498707 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 188/352] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:06.508665 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-339f3aaf-668e-40df-8180-5a65eaacbd1a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:06.523286 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-339f3aaf-668e-40df-8180-5a65eaacbd1a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.342731 Aug 03 12:14:06.535232 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 165/353] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:06 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:06.638081 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6768e068-9729-45b4-93af-9fbb3fc2f35a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:06.639052 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6768e068-9729-45b4-93af-9fbb3fc2f35a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:06.646772 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6768e068-9729-45b4-93af-9fbb3fc2f35a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:06.650426 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6768e068-9729-45b4-93af-9fbb3fc2f35a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:06.651691 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6768e068-9729-45b4-93af-9fbb3fc2f35a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:06.652314 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6768e068-9729-45b4-93af-9fbb3fc2f35a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:06.682579 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-64483f5e-8ff0-4743-8e52-eb0d60b3d7cf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:06.683973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-64483f5e-8ff0-4743-8e52-eb0d60b3d7cf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:06.696983 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-64483f5e-8ff0-4743-8e52-eb0d60b3d7cf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:06.711451 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-64483f5e-8ff0-4743-8e52-eb0d60b3d7cf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:06.712603 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-64483f5e-8ff0-4743-8e52-eb0d60b3d7cf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:06.713224 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-64483f5e-8ff0-4743-8e52-eb0d60b3d7cf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:07.049160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6768e068-9729-45b4-93af-9fbb3fc2f35a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:07.063365 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6768e068-9729-45b4-93af-9fbb3fc2f35a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1557 microversion: 2.1 time: 0.429497 Aug 03 12:14:07.064866 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 189/354] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:06 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1557 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:07.107460 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-64483f5e-8ff0-4743-8e52-eb0d60b3d7cf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:07.139151 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-64483f5e-8ff0-4743-8e52-eb0d60b3d7cf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:07.146146 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-64483f5e-8ff0-4743-8e52-eb0d60b3d7cf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:07.150003 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-64483f5e-8ff0-4743-8e52-eb0d60b3d7cf tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.471610 Aug 03 12:14:07.166482 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-76b04fed-5768-4a2f-bcd7-07ca431c613b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:07.166482 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-76b04fed-5768-4a2f-bcd7-07ca431c613b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:07.172394 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 166/355] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:06 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:07.189166 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-8bb3e5f0-0152-44d8-a6d6-de8aed5685d6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:07.190510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-8bb3e5f0-0152-44d8-a6d6-de8aed5685d6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:07.202378 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8bb3e5f0-0152-44d8-a6d6-de8aed5685d6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:07.203705 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8bb3e5f0-0152-44d8-a6d6-de8aed5685d6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:07.205323 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8bb3e5f0-0152-44d8-a6d6-de8aed5685d6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:07.206252 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8bb3e5f0-0152-44d8-a6d6-de8aed5685d6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:07.217049 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-76b04fed-5768-4a2f-bcd7-07ca431c613b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:07.223822 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-76b04fed-5768-4a2f-bcd7-07ca431c613b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:07.226878 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-76b04fed-5768-4a2f-bcd7-07ca431c613b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:07.227627 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-76b04fed-5768-4a2f-bcd7-07ca431c613b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:07.559550 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-76b04fed-5768-4a2f-bcd7-07ca431c613b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.449639 Aug 03 12:14:07.573012 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 190/356] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 3 12:14:07 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf/os-interface => generated 285 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:07.579354 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-038fe979-adf1-44fe-b0c9-160091e0a271 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:07.581465 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-038fe979-adf1-44fe-b0c9-160091e0a271 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:07.599127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-038fe979-adf1-44fe-b0c9-160091e0a271 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:07.600046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-038fe979-adf1-44fe-b0c9-160091e0a271 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:07.601313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-038fe979-adf1-44fe-b0c9-160091e0a271 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:07.602041 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-038fe979-adf1-44fe-b0c9-160091e0a271 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:07.895770 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=6 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:07.919800 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=30 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:08.009318 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-8bb3e5f0-0152-44d8-a6d6-de8aed5685d6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:08.021006 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-8bb3e5f0-0152-44d8-a6d6-de8aed5685d6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.846754 Aug 03 12:14:08.024840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 167/357] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:07 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:08.039061 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cd3c9b03-d4d9-422c-b41e-6d45228bd61f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:08.039890 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-cd3c9b03-d4d9-422c-b41e-6d45228bd61f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:08.042115 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:08.061376 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd3c9b03-d4d9-422c-b41e-6d45228bd61f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:08.063386 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd3c9b03-d4d9-422c-b41e-6d45228bd61f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:08.064780 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd3c9b03-d4d9-422c-b41e-6d45228bd61f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:08.068624 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd3c9b03-d4d9-422c-b41e-6d45228bd61f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:08.117424 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-038fe979-adf1-44fe-b0c9-160091e0a271 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:08.126874 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-038fe979-adf1-44fe-b0c9-160091e0a271 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.552247 Aug 03 12:14:08.127467 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 191/358] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:07 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:08.192888 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-082d9189-9e57-491b-9ef7-1ca08f4c9cab tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:08.193676 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-082d9189-9e57-491b-9ef7-1ca08f4c9cab tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:08.214374 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-082d9189-9e57-491b-9ef7-1ca08f4c9cab tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:08.216187 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-082d9189-9e57-491b-9ef7-1ca08f4c9cab tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:08.217699 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-082d9189-9e57-491b-9ef7-1ca08f4c9cab tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:08.217699 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-082d9189-9e57-491b-9ef7-1ca08f4c9cab tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:08.274065 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=14 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:08.739302 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-082d9189-9e57-491b-9ef7-1ca08f4c9cab tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:08.788739 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-082d9189-9e57-491b-9ef7-1ca08f4c9cab tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:08.792302 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-082d9189-9e57-491b-9ef7-1ca08f4c9cab tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:08.795353 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-082d9189-9e57-491b-9ef7-1ca08f4c9cab tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.607458 Aug 03 12:14:08.797517 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 192/359] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:08 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:14:08.945220 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cd3c9b03-d4d9-422c-b41e-6d45228bd61f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:08.958308 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-cd3c9b03-d4d9-422c-b41e-6d45228bd61f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.931505 Aug 03 12:14:08.959055 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 168/360] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:08 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:09.051970 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-853dd0f4-3549-4c10-8cdc-35badddc9eb8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:09.055951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-853dd0f4-3549-4c10-8cdc-35badddc9eb8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:09.067583 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-853dd0f4-3549-4c10-8cdc-35badddc9eb8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:09.068113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-853dd0f4-3549-4c10-8cdc-35badddc9eb8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:09.069094 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-853dd0f4-3549-4c10-8cdc-35badddc9eb8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:09.069628 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-853dd0f4-3549-4c10-8cdc-35badddc9eb8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:09.171671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-19f371c3-1dba-404a-bd38-b84c74dc49f1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:09.172448 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-19f371c3-1dba-404a-bd38-b84c74dc49f1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:09.189996 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-19f371c3-1dba-404a-bd38-b84c74dc49f1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:09.190513 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-19f371c3-1dba-404a-bd38-b84c74dc49f1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:09.192987 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-19f371c3-1dba-404a-bd38-b84c74dc49f1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:09.193686 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-19f371c3-1dba-404a-bd38-b84c74dc49f1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:09.323341 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-853dd0f4-3549-4c10-8cdc-35badddc9eb8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:09.340274 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-853dd0f4-3549-4c10-8cdc-35badddc9eb8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.290682 Aug 03 12:14:09.353950 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 193/361] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:09 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:09.566086 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-19f371c3-1dba-404a-bd38-b84c74dc49f1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:09.574808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-19f371c3-1dba-404a-bd38-b84c74dc49f1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.407354 Aug 03 12:14:09.575398 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 169/362] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:09 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:09.821152 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4e978bd3-b6a5-4b7f-9784-82db89d8ad3b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:09.822068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4e978bd3-b6a5-4b7f-9784-82db89d8ad3b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:09.829011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4e978bd3-b6a5-4b7f-9784-82db89d8ad3b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:09.829464 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4e978bd3-b6a5-4b7f-9784-82db89d8ad3b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:09.830276 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4e978bd3-b6a5-4b7f-9784-82db89d8ad3b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:09.830933 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4e978bd3-b6a5-4b7f-9784-82db89d8ad3b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:09.981663 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d942556f-8095-4b6c-8e0c-26d275c3b9f1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:09.982801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d942556f-8095-4b6c-8e0c-26d275c3b9f1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:09.990431 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d942556f-8095-4b6c-8e0c-26d275c3b9f1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:09.990961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d942556f-8095-4b6c-8e0c-26d275c3b9f1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:09.992555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d942556f-8095-4b6c-8e0c-26d275c3b9f1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:09.993170 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d942556f-8095-4b6c-8e0c-26d275c3b9f1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:10.002637 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4e978bd3-b6a5-4b7f-9784-82db89d8ad3b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:10.035527 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4e978bd3-b6a5-4b7f-9784-82db89d8ad3b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:10.037759 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4e978bd3-b6a5-4b7f-9784-82db89d8ad3b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:10.045433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4e978bd3-b6a5-4b7f-9784-82db89d8ad3b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.228871 Aug 03 12:14:10.046846 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 194/363] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:09 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:10.103636 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-cf30598d-f39d-45d6-a008-10be32a4b275 req-b7da0999-0327-4293-a604-3bcf30e71ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2776d6e3-3b32-4548-828f-cc640cc445bf", "tag": "d073cee3-622e-495d-87b3-79a9d0c5308a"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:10.115867 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-cf30598d-f39d-45d6-a008-10be32a4b275 req-b7da0999-0327-4293-a604-3bcf30e71ca3 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:10.117231 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-cf30598d-f39d-45d6-a008-10be32a4b275 req-b7da0999-0327-4293-a604-3bcf30e71ca3 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:10.134004 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-cf30598d-f39d-45d6-a008-10be32a4b275 req-b7da0999-0327-4293-a604-3bcf30e71ca3 service nova] Creating event network-changed:d073cee3-622e-495d-87b3-79a9d0c5308a for instance 2776d6e3-3b32-4548-828f-cc640cc445bf on hv-cinder-83602 Aug 03 12:14:10.144308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-cf30598d-f39d-45d6-a008-10be32a4b275 req-b7da0999-0327-4293-a604-3bcf30e71ca3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042226 Aug 03 12:14:10.145326 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 195/364] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:14:10.287181 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d942556f-8095-4b6c-8e0c-26d275c3b9f1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:10.295968 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d942556f-8095-4b6c-8e0c-26d275c3b9f1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.319655 Aug 03 12:14:10.309892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 170/365] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:09 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:10.363266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9e2c6bee-4fd5-457f-8397-93625f4f582e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:10.364286 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9e2c6bee-4fd5-457f-8397-93625f4f582e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:10.371573 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9e2c6bee-4fd5-457f-8397-93625f4f582e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:10.372060 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9e2c6bee-4fd5-457f-8397-93625f4f582e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:10.372856 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9e2c6bee-4fd5-457f-8397-93625f4f582e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:10.373299 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9e2c6bee-4fd5-457f-8397-93625f4f582e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:10.586110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9e2c6bee-4fd5-457f-8397-93625f4f582e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:10.598590 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9e2c6bee-4fd5-457f-8397-93625f4f582e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.240234 Aug 03 12:14:10.598878 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-87c6223f-1627-4727-a456-16df8484f64a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:10.599299 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-87c6223f-1627-4727-a456-16df8484f64a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:10.610130 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87c6223f-1627-4727-a456-16df8484f64a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:10.610912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87c6223f-1627-4727-a456-16df8484f64a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:10.615389 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 196/366] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:10 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:10.616025 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87c6223f-1627-4727-a456-16df8484f64a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:10.617291 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87c6223f-1627-4727-a456-16df8484f64a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:10.796404 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-87c6223f-1627-4727-a456-16df8484f64a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:10.805552 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-87c6223f-1627-4727-a456-16df8484f64a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.211310 Aug 03 12:14:10.818555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 171/367] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:10 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:11.068918 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7a63607a-1734-4dbb-b235-6c844ffdfd97 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:11.069776 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7a63607a-1734-4dbb-b235-6c844ffdfd97 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:11.084234 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7a63607a-1734-4dbb-b235-6c844ffdfd97 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:11.085201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7a63607a-1734-4dbb-b235-6c844ffdfd97 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:11.086430 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7a63607a-1734-4dbb-b235-6c844ffdfd97 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:11.087193 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7a63607a-1734-4dbb-b235-6c844ffdfd97 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:11.247914 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7a63607a-1734-4dbb-b235-6c844ffdfd97 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:11.270209 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7a63607a-1734-4dbb-b235-6c844ffdfd97 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:11.271803 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7a63607a-1734-4dbb-b235-6c844ffdfd97 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:11.273562 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7a63607a-1734-4dbb-b235-6c844ffdfd97 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.208673 Aug 03 12:14:11.289669 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 197/368] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:11 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:11.316806 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2fa90e62-a7ea-4812-8562-20d319b3aa86 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:11.317442 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2fa90e62-a7ea-4812-8562-20d319b3aa86 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:11.331137 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2fa90e62-a7ea-4812-8562-20d319b3aa86 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:11.331595 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2fa90e62-a7ea-4812-8562-20d319b3aa86 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:11.332398 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2fa90e62-a7ea-4812-8562-20d319b3aa86 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:11.332844 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2fa90e62-a7ea-4812-8562-20d319b3aa86 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:11.517412 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2fa90e62-a7ea-4812-8562-20d319b3aa86 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:11.526072 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2fa90e62-a7ea-4812-8562-20d319b3aa86 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.213077 Aug 03 12:14:11.537506 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 172/369] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:11 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:11.621989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6d5f7fc5-7657-4c4c-a72f-3ce29c3533ae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:11.622769 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6d5f7fc5-7657-4c4c-a72f-3ce29c3533ae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:11.635773 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6d5f7fc5-7657-4c4c-a72f-3ce29c3533ae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:11.636232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6d5f7fc5-7657-4c4c-a72f-3ce29c3533ae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:11.637064 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6d5f7fc5-7657-4c4c-a72f-3ce29c3533ae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:11.637507 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6d5f7fc5-7657-4c4c-a72f-3ce29c3533ae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:11.786061 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6d5f7fc5-7657-4c4c-a72f-3ce29c3533ae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:11.794742 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6d5f7fc5-7657-4c4c-a72f-3ce29c3533ae tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.176714 Aug 03 12:14:11.795338 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 198/370] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:11 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:11.831033 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1cf5dbc4-b54a-4513-9aad-a7c26d4d64f6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:11.831742 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1cf5dbc4-b54a-4513-9aad-a7c26d4d64f6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:11.840217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1cf5dbc4-b54a-4513-9aad-a7c26d4d64f6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:11.840671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1cf5dbc4-b54a-4513-9aad-a7c26d4d64f6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:11.841448 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1cf5dbc4-b54a-4513-9aad-a7c26d4d64f6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:11.841912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1cf5dbc4-b54a-4513-9aad-a7c26d4d64f6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:11.994204 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1cf5dbc4-b54a-4513-9aad-a7c26d4d64f6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:12.003847 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1cf5dbc4-b54a-4513-9aad-a7c26d4d64f6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.177608 Aug 03 12:14:12.004444 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 173/371] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:11 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:12.304766 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-99681c9c-cc51-4efa-a8ad-c93f305deae3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:12.305813 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-99681c9c-cc51-4efa-a8ad-c93f305deae3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:12.312321 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-99681c9c-cc51-4efa-a8ad-c93f305deae3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:12.312765 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-99681c9c-cc51-4efa-a8ad-c93f305deae3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:12.313527 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-99681c9c-cc51-4efa-a8ad-c93f305deae3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:12.313958 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-99681c9c-cc51-4efa-a8ad-c93f305deae3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:12.491554 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-99681c9c-cc51-4efa-a8ad-c93f305deae3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:12.500823 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-99681c9c-cc51-4efa-a8ad-c93f305deae3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:12.502410 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-99681c9c-cc51-4efa-a8ad-c93f305deae3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:12.503771 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-99681c9c-cc51-4efa-a8ad-c93f305deae3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.205838 Aug 03 12:14:12.518892 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 199/372] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:12 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:12.553501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-52f01b73-82d6-4008-9919-24da5c582e8f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:12.554228 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-52f01b73-82d6-4008-9919-24da5c582e8f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:12.561574 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-52f01b73-82d6-4008-9919-24da5c582e8f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:12.561918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-52f01b73-82d6-4008-9919-24da5c582e8f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:12.562785 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-52f01b73-82d6-4008-9919-24da5c582e8f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:12.563229 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-52f01b73-82d6-4008-9919-24da5c582e8f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:12.773184 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-52f01b73-82d6-4008-9919-24da5c582e8f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:12.782224 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-52f01b73-82d6-4008-9919-24da5c582e8f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.232709 Aug 03 12:14:12.782985 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 174/373] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:12 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:12.818234 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-29611261-a354-4837-b78b-807c9599439e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:12.818837 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-29611261-a354-4837-b78b-807c9599439e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:12.826197 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29611261-a354-4837-b78b-807c9599439e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:12.827076 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29611261-a354-4837-b78b-807c9599439e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:12.828154 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29611261-a354-4837-b78b-807c9599439e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:12.828824 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-29611261-a354-4837-b78b-807c9599439e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:13.017845 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-29611261-a354-4837-b78b-807c9599439e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:13.029992 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-550fbc9a-2296-4705-a4a3-f2f9acce8f86 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:13.030737 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-550fbc9a-2296-4705-a4a3-f2f9acce8f86 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:13.043569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-29611261-a354-4837-b78b-807c9599439e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.229496 Aug 03 12:14:13.044393 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-550fbc9a-2296-4705-a4a3-f2f9acce8f86 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:13.044958 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-550fbc9a-2296-4705-a4a3-f2f9acce8f86 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:13.045961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-550fbc9a-2296-4705-a4a3-f2f9acce8f86 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:13.046603 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-550fbc9a-2296-4705-a4a3-f2f9acce8f86 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:13.051458 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 200/374] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:12 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:13.253194 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-550fbc9a-2296-4705-a4a3-f2f9acce8f86 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:13.264220 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-550fbc9a-2296-4705-a4a3-f2f9acce8f86 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.237839 Aug 03 12:14:13.265407 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 175/375] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:13 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:13.529875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b1566ae2-54ab-406c-bef1-a2ebe3c27e94 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:13.530697 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b1566ae2-54ab-406c-bef1-a2ebe3c27e94 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:13.538888 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b1566ae2-54ab-406c-bef1-a2ebe3c27e94 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:13.539757 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b1566ae2-54ab-406c-bef1-a2ebe3c27e94 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:13.540917 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b1566ae2-54ab-406c-bef1-a2ebe3c27e94 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:13.541612 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b1566ae2-54ab-406c-bef1-a2ebe3c27e94 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:13.716066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b1566ae2-54ab-406c-bef1-a2ebe3c27e94 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:13.724521 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b1566ae2-54ab-406c-bef1-a2ebe3c27e94 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:13.726657 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b1566ae2-54ab-406c-bef1-a2ebe3c27e94 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:13.727872 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b1566ae2-54ab-406c-bef1-a2ebe3c27e94 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.202812 Aug 03 12:14:13.728449 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 201/376] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:13 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:13.804274 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6bade0f1-4e87-49a0-aa98-24556314b452 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:13.804909 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-6bade0f1-4e87-49a0-aa98-24556314b452 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:13.811858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6bade0f1-4e87-49a0-aa98-24556314b452 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:13.812312 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6bade0f1-4e87-49a0-aa98-24556314b452 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:13.813106 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6bade0f1-4e87-49a0-aa98-24556314b452 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:13.813543 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6bade0f1-4e87-49a0-aa98-24556314b452 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:13.969015 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-6bade0f1-4e87-49a0-aa98-24556314b452 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:13.980378 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6bade0f1-4e87-49a0-aa98-24556314b452 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.179936 Aug 03 12:14:13.981368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 176/377] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:13 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:14.083585 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3db42e90-dae5-4c9c-be66-28d639f71e88 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:14.084216 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3db42e90-dae5-4c9c-be66-28d639f71e88 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:14.091068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3db42e90-dae5-4c9c-be66-28d639f71e88 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:14.091531 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3db42e90-dae5-4c9c-be66-28d639f71e88 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:14.092314 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3db42e90-dae5-4c9c-be66-28d639f71e88 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:14.092751 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3db42e90-dae5-4c9c-be66-28d639f71e88 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:14.225539 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3db42e90-dae5-4c9c-be66-28d639f71e88 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:14.233053 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3db42e90-dae5-4c9c-be66-28d639f71e88 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.153585 Aug 03 12:14:14.233632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 202/378] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:14 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:14.290743 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-914fb01d-af72-4083-b50b-c32edc5fb9ad tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:14.291363 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-914fb01d-af72-4083-b50b-c32edc5fb9ad tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:14.297559 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-914fb01d-af72-4083-b50b-c32edc5fb9ad tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:14.298008 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-914fb01d-af72-4083-b50b-c32edc5fb9ad tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:14.298815 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-914fb01d-af72-4083-b50b-c32edc5fb9ad tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:14.299258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-914fb01d-af72-4083-b50b-c32edc5fb9ad tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:14.319168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=100 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:14.441377 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-914fb01d-af72-4083-b50b-c32edc5fb9ad tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:14.449696 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-914fb01d-af72-4083-b50b-c32edc5fb9ad tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1371 microversion: 2.1 time: 0.162905 Aug 03 12:14:14.450272 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 177/379] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:14 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:14.751112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a9af6652-5d2c-43cc-9dec-000c1c398917 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:14.751731 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a9af6652-5d2c-43cc-9dec-000c1c398917 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:14.757817 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9af6652-5d2c-43cc-9dec-000c1c398917 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:14.758268 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9af6652-5d2c-43cc-9dec-000c1c398917 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:14.759075 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9af6652-5d2c-43cc-9dec-000c1c398917 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:14.759521 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a9af6652-5d2c-43cc-9dec-000c1c398917 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:14.778073 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:14.896283 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a9af6652-5d2c-43cc-9dec-000c1c398917 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:14.904709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a9af6652-5d2c-43cc-9dec-000c1c398917 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:14.906223 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a9af6652-5d2c-43cc-9dec-000c1c398917 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:14.907406 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a9af6652-5d2c-43cc-9dec-000c1c398917 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1739 microversion: 2.20 time: 0.160217 Aug 03 12:14:14.907959 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 203/380] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:14 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:15.002746 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-702b68b2-2af0-4a48-ab21-dc4f885f4e6b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:15.003370 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-702b68b2-2af0-4a48-ab21-dc4f885f4e6b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:15.010108 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-702b68b2-2af0-4a48-ab21-dc4f885f4e6b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:15.010610 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-702b68b2-2af0-4a48-ab21-dc4f885f4e6b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:15.011398 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-702b68b2-2af0-4a48-ab21-dc4f885f4e6b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:15.011843 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-702b68b2-2af0-4a48-ab21-dc4f885f4e6b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:15.164340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-702b68b2-2af0-4a48-ab21-dc4f885f4e6b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:15.172116 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-702b68b2-2af0-4a48-ab21-dc4f885f4e6b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.174841 Aug 03 12:14:15.172693 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 178/381] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:14 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:15.255369 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8de1d2db-6b8e-4d90-8391-f61074e98f6b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:15.255958 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8de1d2db-6b8e-4d90-8391-f61074e98f6b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:15.262631 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8de1d2db-6b8e-4d90-8391-f61074e98f6b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:15.263085 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8de1d2db-6b8e-4d90-8391-f61074e98f6b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:15.263855 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8de1d2db-6b8e-4d90-8391-f61074e98f6b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:15.264294 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8de1d2db-6b8e-4d90-8391-f61074e98f6b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:15.482861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3c8a7c4a-5c37-499c-bcdc-64aad700f9bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:15.484010 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-3c8a7c4a-5c37-499c-bcdc-64aad700f9bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:15.498941 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8de1d2db-6b8e-4d90-8391-f61074e98f6b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:15.500760 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3c8a7c4a-5c37-499c-bcdc-64aad700f9bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:15.501289 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3c8a7c4a-5c37-499c-bcdc-64aad700f9bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:15.502193 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3c8a7c4a-5c37-499c-bcdc-64aad700f9bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:15.502841 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3c8a7c4a-5c37-499c-bcdc-64aad700f9bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:15.509519 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8de1d2db-6b8e-4d90-8391-f61074e98f6b tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.257591 Aug 03 12:14:15.510594 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 204/382] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:15 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:15.654242 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-3c8a7c4a-5c37-499c-bcdc-64aad700f9bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:15.662012 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-3c8a7c4a-5c37-499c-bcdc-64aad700f9bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1565 microversion: 2.1 time: 0.193448 Aug 03 12:14:15.662624 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 179/383] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:15 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1565 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:15.683562 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d4795faa-3cf6-4764-a222-7ad4615fa5fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:15.684110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d4795faa-3cf6-4764-a222-7ad4615fa5fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:15.690501 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d4795faa-3cf6-4764-a222-7ad4615fa5fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:15.690956 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d4795faa-3cf6-4764-a222-7ad4615fa5fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:15.691741 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d4795faa-3cf6-4764-a222-7ad4615fa5fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:15.692181 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d4795faa-3cf6-4764-a222-7ad4615fa5fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:15.819142 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d4795faa-3cf6-4764-a222-7ad4615fa5fc tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140036 Aug 03 12:14:15.820414 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 205/384] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 3 12:14:15 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:15.931804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f64441b8-8701-4d8c-a629-fb7b89eb5234 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:15.932465 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f64441b8-8701-4d8c-a629-fb7b89eb5234 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:15.940134 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f64441b8-8701-4d8c-a629-fb7b89eb5234 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:15.940134 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f64441b8-8701-4d8c-a629-fb7b89eb5234 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:15.940451 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f64441b8-8701-4d8c-a629-fb7b89eb5234 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:15.941127 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f64441b8-8701-4d8c-a629-fb7b89eb5234 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:16.200522 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1ca5bffc-d6a6-4b2c-9b11-151dc8f54b1d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:16.201873 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1ca5bffc-d6a6-4b2c-9b11-151dc8f54b1d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:16.213572 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ca5bffc-d6a6-4b2c-9b11-151dc8f54b1d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:16.214561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ca5bffc-d6a6-4b2c-9b11-151dc8f54b1d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:16.217195 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ca5bffc-d6a6-4b2c-9b11-151dc8f54b1d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:16.218356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1ca5bffc-d6a6-4b2c-9b11-151dc8f54b1d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:16.605420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1ca5bffc-d6a6-4b2c-9b11-151dc8f54b1d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:16.617003 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1ca5bffc-d6a6-4b2c-9b11-151dc8f54b1d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.426380 Aug 03 12:14:16.617923 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 206/385] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:16 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:16.620086 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f64441b8-8701-4d8c-a629-fb7b89eb5234 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:16.623329 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-73ef4590-f534-4621-8678-6c6faf0ed547 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:16.624401 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-73ef4590-f534-4621-8678-6c6faf0ed547 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:16.631304 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-73ef4590-f534-4621-8678-6c6faf0ed547 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:16.631881 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-73ef4590-f534-4621-8678-6c6faf0ed547 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:16.632758 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-73ef4590-f534-4621-8678-6c6faf0ed547 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:16.633274 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-73ef4590-f534-4621-8678-6c6faf0ed547 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:16.633525 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f64441b8-8701-4d8c-a629-fb7b89eb5234 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:16.635092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f64441b8-8701-4d8c-a629-fb7b89eb5234 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:16.636298 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f64441b8-8701-4d8c-a629-fb7b89eb5234 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1721 microversion: 2.20 time: 0.709460 Aug 03 12:14:16.637080 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 180/386] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:15 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1721 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:17.141426 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-73ef4590-f534-4621-8678-6c6faf0ed547 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:17.150747 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-73ef4590-f534-4621-8678-6c6faf0ed547 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.531368 Aug 03 12:14:17.151345 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 207/387] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:16 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:17.562057 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-0cbae249-9da4-4c22-9eb1-54f99ecf9d35 req-57389f3e-2218-453d-80ed-fab5cd5a81f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b98bd00-4a41-43d7-a5c6-ff4644582d13", "tag": "2946f3bb-8068-403a-8fc7-8e8c09e8d7c8"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:17.573148 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-0cbae249-9da4-4c22-9eb1-54f99ecf9d35 req-57389f3e-2218-453d-80ed-fab5cd5a81f9 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:17.573598 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-0cbae249-9da4-4c22-9eb1-54f99ecf9d35 req-57389f3e-2218-453d-80ed-fab5cd5a81f9 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:17.588127 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-0cbae249-9da4-4c22-9eb1-54f99ecf9d35 req-57389f3e-2218-453d-80ed-fab5cd5a81f9 service nova] Creating event network-changed:2946f3bb-8068-403a-8fc7-8e8c09e8d7c8 for instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 on hv-cinder-83602 Aug 03 12:14:17.593762 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-0cbae249-9da4-4c22-9eb1-54f99ecf9d35 req-57389f3e-2218-453d-80ed-fab5cd5a81f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035175 Aug 03 12:14:17.594836 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 181/388] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:17.646547 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d7722ba4-1608-4cd4-967d-59f3b8ed62fc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:17.649139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d7722ba4-1608-4cd4-967d-59f3b8ed62fc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:17.663150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-db472d8b-c7ee-4fb4-94d6-42eccacb1d19 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:17.665198 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-db472d8b-c7ee-4fb4-94d6-42eccacb1d19 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:17.679843 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d7722ba4-1608-4cd4-967d-59f3b8ed62fc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:17.680988 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d7722ba4-1608-4cd4-967d-59f3b8ed62fc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:17.683543 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-db472d8b-c7ee-4fb4-94d6-42eccacb1d19 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:17.685461 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d7722ba4-1608-4cd4-967d-59f3b8ed62fc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:17.686522 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d7722ba4-1608-4cd4-967d-59f3b8ed62fc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:17.692792 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-db472d8b-c7ee-4fb4-94d6-42eccacb1d19 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:17.695460 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-db472d8b-c7ee-4fb4-94d6-42eccacb1d19 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:17.696531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-db472d8b-c7ee-4fb4-94d6-42eccacb1d19 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:17.956309 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d7722ba4-1608-4cd4-967d-59f3b8ed62fc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:17.964773 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d7722ba4-1608-4cd4-967d-59f3b8ed62fc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.325619 Aug 03 12:14:17.965733 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 208/389] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:17 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:18.174981 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4b52627a-8d8f-4f55-a8b2-31e7d591be70 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:18.180108 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4b52627a-8d8f-4f55-a8b2-31e7d591be70 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:18.192442 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b52627a-8d8f-4f55-a8b2-31e7d591be70 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:18.193093 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b52627a-8d8f-4f55-a8b2-31e7d591be70 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:18.196241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b52627a-8d8f-4f55-a8b2-31e7d591be70 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:18.197003 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b52627a-8d8f-4f55-a8b2-31e7d591be70 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:18.230417 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-db472d8b-c7ee-4fb4-94d6-42eccacb1d19 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:18.243333 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-db472d8b-c7ee-4fb4-94d6-42eccacb1d19 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:18.251626 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-db472d8b-c7ee-4fb4-94d6-42eccacb1d19 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:18.261795 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-db472d8b-c7ee-4fb4-94d6-42eccacb1d19 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1721 microversion: 2.20 time: 0.597845 Aug 03 12:14:18.262828 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 182/390] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:17 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1721 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:14:18.481111 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4b52627a-8d8f-4f55-a8b2-31e7d591be70 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:18.511285 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c7282e98-ac35-4182-b4f9-1620d17b0718 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:18.512675 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-c7282e98-ac35-4182-b4f9-1620d17b0718 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:18.522341 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4b52627a-8d8f-4f55-a8b2-31e7d591be70 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.351146 Aug 03 12:14:18.523542 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 209/391] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:18 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:18.534656 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c7282e98-ac35-4182-b4f9-1620d17b0718 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:18.534656 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c7282e98-ac35-4182-b4f9-1620d17b0718 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:18.534656 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c7282e98-ac35-4182-b4f9-1620d17b0718 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:18.534656 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c7282e98-ac35-4182-b4f9-1620d17b0718 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:18.561257 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c7282e98-ac35-4182-b4f9-1620d17b0718 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/ips" status: 200 len: 143 microversion: 2.1 time: 0.056782 Aug 03 12:14:18.562139 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 183/392] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 3 12:14:18 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/ips => generated 143 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:14:18.999495 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-202aa3d6-2a4a-4220-980e-79700ce724c3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:19.000284 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-202aa3d6-2a4a-4220-980e-79700ce724c3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:19.008567 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-202aa3d6-2a4a-4220-980e-79700ce724c3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:19.009017 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-202aa3d6-2a4a-4220-980e-79700ce724c3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:19.009807 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-202aa3d6-2a4a-4220-980e-79700ce724c3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:19.010277 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-202aa3d6-2a4a-4220-980e-79700ce724c3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:19.156295 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-202aa3d6-2a4a-4220-980e-79700ce724c3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:19.164375 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-202aa3d6-2a4a-4220-980e-79700ce724c3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.168712 Aug 03 12:14:19.166931 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 210/393] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:18 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:19.289580 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-55818065-c78b-40ab-bd80-ee378e5b0053 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:19.290566 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-55818065-c78b-40ab-bd80-ee378e5b0053 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:19.300667 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-55818065-c78b-40ab-bd80-ee378e5b0053 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:19.301217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-55818065-c78b-40ab-bd80-ee378e5b0053 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:19.302010 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-55818065-c78b-40ab-bd80-ee378e5b0053 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:19.302475 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-55818065-c78b-40ab-bd80-ee378e5b0053 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:19.453420 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-55818065-c78b-40ab-bd80-ee378e5b0053 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:19.462121 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-55818065-c78b-40ab-bd80-ee378e5b0053 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:19.464003 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-55818065-c78b-40ab-bd80-ee378e5b0053 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:19.465256 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-55818065-c78b-40ab-bd80-ee378e5b0053 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1721 microversion: 2.20 time: 0.182885 Aug 03 12:14:19.465841 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 184/394] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:19 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:19.547085 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-81fe27ec-dec0-4934-bb59-64afb8445335 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:19.547701 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-81fe27ec-dec0-4934-bb59-64afb8445335 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:19.554866 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-81fe27ec-dec0-4934-bb59-64afb8445335 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:19.555377 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-81fe27ec-dec0-4934-bb59-64afb8445335 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:19.556157 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-81fe27ec-dec0-4934-bb59-64afb8445335 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:19.556611 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-81fe27ec-dec0-4934-bb59-64afb8445335 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:19.678211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-f4beb6ed-5ec6-484e-9c55-fa35da27018d req-cc02d739-194e-4b24-8d00-7c4ecca3c86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afb38cd-ec9c-4509-b7c8-91b170684ec5", "name": "network-vif-unplugged", "status": "completed", "tag": "8f2969cf-b117-4fef-a2f6-5587992eefda"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:19.701475 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-f4beb6ed-5ec6-484e-9c55-fa35da27018d req-cc02d739-194e-4b24-8d00-7c4ecca3c86e service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:19.701925 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-f4beb6ed-5ec6-484e-9c55-fa35da27018d req-cc02d739-194e-4b24-8d00-7c4ecca3c86e service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:19.703375 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-81fe27ec-dec0-4934-bb59-64afb8445335 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:19.714288 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-81fe27ec-dec0-4934-bb59-64afb8445335 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.171456 Aug 03 12:14:19.719444 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-f4beb6ed-5ec6-484e-9c55-fa35da27018d req-cc02d739-194e-4b24-8d00-7c4ecca3c86e service nova] Creating event network-vif-unplugged:8f2969cf-b117-4fef-a2f6-5587992eefda for instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 on hv-cinder-83602 Aug 03 12:14:19.725717 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-f4beb6ed-5ec6-484e-9c55-fa35da27018d req-cc02d739-194e-4b24-8d00-7c4ecca3c86e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053088 Aug 03 12:14:19.727050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 185/395] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:19.727535 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 211/396] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:19 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:20.187340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7cec13e0-633e-42e8-9cdc-8e6e1a04bd9f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:20.188123 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7cec13e0-633e-42e8-9cdc-8e6e1a04bd9f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:20.195965 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7cec13e0-633e-42e8-9cdc-8e6e1a04bd9f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:20.196415 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7cec13e0-633e-42e8-9cdc-8e6e1a04bd9f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:20.197198 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7cec13e0-633e-42e8-9cdc-8e6e1a04bd9f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:20.197640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7cec13e0-633e-42e8-9cdc-8e6e1a04bd9f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:20.349969 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7cec13e0-633e-42e8-9cdc-8e6e1a04bd9f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:20.358387 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7cec13e0-633e-42e8-9cdc-8e6e1a04bd9f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.176383 Aug 03 12:14:20.359008 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 186/397] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:20 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:20.489608 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-237a8912-4816-4e7d-90bc-a55f1d1cc52f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:20.490424 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-237a8912-4816-4e7d-90bc-a55f1d1cc52f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:20.497930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-237a8912-4816-4e7d-90bc-a55f1d1cc52f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:20.498382 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-237a8912-4816-4e7d-90bc-a55f1d1cc52f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:20.499205 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-237a8912-4816-4e7d-90bc-a55f1d1cc52f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:20.499940 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-237a8912-4816-4e7d-90bc-a55f1d1cc52f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:20.650516 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-237a8912-4816-4e7d-90bc-a55f1d1cc52f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:20.664138 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-237a8912-4816-4e7d-90bc-a55f1d1cc52f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:20.666234 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-237a8912-4816-4e7d-90bc-a55f1d1cc52f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:20.667643 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-237a8912-4816-4e7d-90bc-a55f1d1cc52f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1721 microversion: 2.20 time: 0.182714 Aug 03 12:14:20.668693 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 212/398] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:20 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:20.736831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-dcbf3fd3-41ce-4eee-89d5-734e15a5d946 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:20.737514 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-dcbf3fd3-41ce-4eee-89d5-734e15a5d946 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:20.744805 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcbf3fd3-41ce-4eee-89d5-734e15a5d946 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:20.745257 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcbf3fd3-41ce-4eee-89d5-734e15a5d946 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:20.746129 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcbf3fd3-41ce-4eee-89d5-734e15a5d946 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:20.746608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcbf3fd3-41ce-4eee-89d5-734e15a5d946 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:20.900284 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dcbf3fd3-41ce-4eee-89d5-734e15a5d946 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:20.908227 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-dcbf3fd3-41ce-4eee-89d5-734e15a5d946 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.175246 Aug 03 12:14:20.908824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 187/399] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:20 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:21.122736 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7667abba-e92a-4bc0-8dd5-3ff328b6727a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a725cf3d-3788-4fbc-8f2b-e4331db0f97c"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:21.125170 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7667abba-e92a-4bc0-8dd5-3ff328b6727a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:21.132286 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7667abba-e92a-4bc0-8dd5-3ff328b6727a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:21.132737 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7667abba-e92a-4bc0-8dd5-3ff328b6727a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:21.133522 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7667abba-e92a-4bc0-8dd5-3ff328b6727a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:21.133961 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7667abba-e92a-4bc0-8dd5-3ff328b6727a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:21.389099 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-dbbe2d25-c553-4566-bdeb-0f4e875dea23 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:21.390243 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-dbbe2d25-c553-4566-bdeb-0f4e875dea23 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:21.402032 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dbbe2d25-c553-4566-bdeb-0f4e875dea23 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:21.402554 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dbbe2d25-c553-4566-bdeb-0f4e875dea23 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:21.403925 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dbbe2d25-c553-4566-bdeb-0f4e875dea23 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:21.404705 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dbbe2d25-c553-4566-bdeb-0f4e875dea23 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:21.585951 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dbbe2d25-c553-4566-bdeb-0f4e875dea23 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:21.594658 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-dbbe2d25-c553-4566-bdeb-0f4e875dea23 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.213290 Aug 03 12:14:21.595248 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 188/400] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:21 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:21.694907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1f0faffd-2e79-491d-827c-bfc1b6f40387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:21.696169 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1f0faffd-2e79-491d-827c-bfc1b6f40387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:21.707975 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1f0faffd-2e79-491d-827c-bfc1b6f40387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:21.708886 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1f0faffd-2e79-491d-827c-bfc1b6f40387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:21.712665 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1f0faffd-2e79-491d-827c-bfc1b6f40387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:21.713482 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1f0faffd-2e79-491d-827c-bfc1b6f40387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:21.938582 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1f0faffd-2e79-491d-827c-bfc1b6f40387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:21.949794 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1f0faffd-2e79-491d-827c-bfc1b6f40387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:21.951717 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1f0faffd-2e79-491d-827c-bfc1b6f40387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:21.953264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1f0faffd-2e79-491d-827c-bfc1b6f40387 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1721 microversion: 2.20 time: 0.264593 Aug 03 12:14:21.953981 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 189/401] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:21 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:14:21.965937 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-b09782c9-3f37-473c-aa2a-8a010bd23560 req-dfbe21ac-4c99-4dc8-a7ec-93e1884eab95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef0b56c-b712-49ca-8847-a0acbc0a729a", "name": "network-vif-plugged", "status": "completed", "tag": "c2052327-4535-436a-9914-53604665eddd"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:21.966219 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7667abba-e92a-4bc0-8dd5-3ff328b6727a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "POST /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840955 Aug 03 12:14:21.966219 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 213/402] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:14:21 2022] POST /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/os-volume_attachments => generated 194 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:21.967385 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-38e12efe-2904-4e0e-9d01-1e6b643bf5b0 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:21.968469 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-38e12efe-2904-4e0e-9d01-1e6b643bf5b0 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:21.971357 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-b09782c9-3f37-473c-aa2a-8a010bd23560 req-dfbe21ac-4c99-4dc8-a7ec-93e1884eab95 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:21.971752 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-b09782c9-3f37-473c-aa2a-8a010bd23560 req-dfbe21ac-4c99-4dc8-a7ec-93e1884eab95 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:21.976412 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-38e12efe-2904-4e0e-9d01-1e6b643bf5b0 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:21.977233 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-38e12efe-2904-4e0e-9d01-1e6b643bf5b0 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:21.978249 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-38e12efe-2904-4e0e-9d01-1e6b643bf5b0 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:21.978914 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-38e12efe-2904-4e0e-9d01-1e6b643bf5b0 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:21.986775 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-b09782c9-3f37-473c-aa2a-8a010bd23560 req-dfbe21ac-4c99-4dc8-a7ec-93e1884eab95 service nova] Creating event network-vif-plugged:c2052327-4535-436a-9914-53604665eddd for instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a on hv-cinder-83602 Aug 03 12:14:21.994500 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-b09782c9-3f37-473c-aa2a-8a010bd23560 req-dfbe21ac-4c99-4dc8-a7ec-93e1884eab95 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038357 Aug 03 12:14:21.995412 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 190/403] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:22.143216 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-38e12efe-2904-4e0e-9d01-1e6b643bf5b0 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:22.151826 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-38e12efe-2904-4e0e-9d01-1e6b643bf5b0 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.189886 Aug 03 12:14:22.152433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 214/404] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:21 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:22.627583 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2f8cc46d-c5af-453a-a218-c6cfe877ff39 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:22.628191 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2f8cc46d-c5af-453a-a218-c6cfe877ff39 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:22.635738 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2f8cc46d-c5af-453a-a218-c6cfe877ff39 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:22.636187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2f8cc46d-c5af-453a-a218-c6cfe877ff39 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:22.636964 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2f8cc46d-c5af-453a-a218-c6cfe877ff39 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:22.637403 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2f8cc46d-c5af-453a-a218-c6cfe877ff39 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:22.786076 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2f8cc46d-c5af-453a-a218-c6cfe877ff39 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:22.796393 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2f8cc46d-c5af-453a-a218-c6cfe877ff39 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.173700 Aug 03 12:14:22.796988 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 191/405] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:22 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:22.983487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4c756391-c756-432e-b0f3-4b0fc9021c1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:22.984050 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4c756391-c756-432e-b0f3-4b0fc9021c1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:22.990651 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4c756391-c756-432e-b0f3-4b0fc9021c1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:22.991700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4c756391-c756-432e-b0f3-4b0fc9021c1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:22.992569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4c756391-c756-432e-b0f3-4b0fc9021c1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:22.993026 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4c756391-c756-432e-b0f3-4b0fc9021c1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:23.147708 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4c756391-c756-432e-b0f3-4b0fc9021c1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:23.156766 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4c756391-c756-432e-b0f3-4b0fc9021c1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:23.158299 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4c756391-c756-432e-b0f3-4b0fc9021c1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:23.159525 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4c756391-c756-432e-b0f3-4b0fc9021c1d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1664 microversion: 2.20 time: 0.180081 Aug 03 12:14:23.160091 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 215/406] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:22 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:23.174764 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7372d503-b5d3-4595-9123-6c8d9ac3c4b8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:23.175393 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7372d503-b5d3-4595-9123-6c8d9ac3c4b8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:23.182875 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7372d503-b5d3-4595-9123-6c8d9ac3c4b8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:23.183327 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7372d503-b5d3-4595-9123-6c8d9ac3c4b8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:23.184123 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7372d503-b5d3-4595-9123-6c8d9ac3c4b8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:23.184444 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-56aace49-e4d7-46b4-9810-aa79221c1138 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e1ff698-cbe6-47e8-8f8d-92b2f6e2e939"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:23.184657 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7372d503-b5d3-4595-9123-6c8d9ac3c4b8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:23.187532 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-56aace49-e4d7-46b4-9810-aa79221c1138 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:23.194261 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-56aace49-e4d7-46b4-9810-aa79221c1138 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:23.194757 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-56aace49-e4d7-46b4-9810-aa79221c1138 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:23.195697 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-56aace49-e4d7-46b4-9810-aa79221c1138 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:23.196132 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-56aace49-e4d7-46b4-9810-aa79221c1138 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:23.357899 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7372d503-b5d3-4595-9123-6c8d9ac3c4b8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:23.365574 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7372d503-b5d3-4595-9123-6c8d9ac3c4b8 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.194826 Aug 03 12:14:23.369771 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 192/407] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:23 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:23.505614 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:23.519983 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-56aace49-e4d7-46b4-9810-aa79221c1138 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "POST /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.340173 Aug 03 12:14:23.520913 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 216/408] 10.222.0.17 () {62 vars in 1364 bytes} [Wed Aug 3 12:14:23 2022] POST /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/os-volume_attachments => generated 188 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:14:23.716239 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-41d7c51d-42c7-492c-a503-7d8650ede78b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:23.717398 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-41d7c51d-42c7-492c-a503-7d8650ede78b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:23.731033 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-41d7c51d-42c7-492c-a503-7d8650ede78b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:23.731865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-41d7c51d-42c7-492c-a503-7d8650ede78b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:23.733287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-41d7c51d-42c7-492c-a503-7d8650ede78b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:23.734026 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-41d7c51d-42c7-492c-a503-7d8650ede78b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:23.799707 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-41d7c51d-42c7-492c-a503-7d8650ede78b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117911) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 12:14:23.819754 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9d426282-ff37-4d4c-a4d2-b081fbbf148b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:23.820585 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9d426282-ff37-4d4c-a4d2-b081fbbf148b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:23.827993 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9d426282-ff37-4d4c-a4d2-b081fbbf148b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:23.828473 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9d426282-ff37-4d4c-a4d2-b081fbbf148b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:23.829436 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9d426282-ff37-4d4c-a4d2-b081fbbf148b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:23.829876 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9d426282-ff37-4d4c-a4d2-b081fbbf148b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:23.927291 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-41d7c51d-42c7-492c-a503-7d8650ede78b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "POST /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/action" status: 202 len: 0 microversion: 2.20 time: 0.216902 Aug 03 12:14:23.930884 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 193/409] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Aug 3 12:14:23 2022] POST /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:14:23.944991 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-496a2182-d9c0-4d35-9763-9e580b4a8384 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:23.946107 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-496a2182-d9c0-4d35-9763-9e580b4a8384 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:23.953648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-496a2182-d9c0-4d35-9763-9e580b4a8384 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:23.954679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-496a2182-d9c0-4d35-9763-9e580b4a8384 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:23.954943 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-496a2182-d9c0-4d35-9763-9e580b4a8384 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:23.955380 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-496a2182-d9c0-4d35-9763-9e580b4a8384 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:24.013099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9d426282-ff37-4d4c-a4d2-b081fbbf148b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:24.024155 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9d426282-ff37-4d4c-a4d2-b081fbbf148b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.209394 Aug 03 12:14:24.024815 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 217/410] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:23 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:24.137349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-496a2182-d9c0-4d35-9763-9e580b4a8384 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:24.152326 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-496a2182-d9c0-4d35-9763-9e580b4a8384 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:24.152889 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-496a2182-d9c0-4d35-9763-9e580b4a8384 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:24.159573 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-496a2182-d9c0-4d35-9763-9e580b4a8384 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1750 microversion: 2.20 time: 0.222131 Aug 03 12:14:24.176207 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 194/411] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:23 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1750 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:24.394560 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7af901c1-8ee3-4b4a-8e84-a312a95dd138 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:24.398378 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7af901c1-8ee3-4b4a-8e84-a312a95dd138 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:24.409432 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7af901c1-8ee3-4b4a-8e84-a312a95dd138 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:24.411240 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7af901c1-8ee3-4b4a-8e84-a312a95dd138 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:24.412999 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7af901c1-8ee3-4b4a-8e84-a312a95dd138 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:24.413628 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7af901c1-8ee3-4b4a-8e84-a312a95dd138 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:24.583224 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7af901c1-8ee3-4b4a-8e84-a312a95dd138 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:24.591397 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7af901c1-8ee3-4b4a-8e84-a312a95dd138 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1359 microversion: 2.1 time: 0.203587 Aug 03 12:14:24.592257 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 218/412] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:24 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:25.045805 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-8331112c-4c73-4a3f-89ac-8a0a03bd889f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:25.046342 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-8331112c-4c73-4a3f-89ac-8a0a03bd889f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:25.053035 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8331112c-4c73-4a3f-89ac-8a0a03bd889f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:25.053494 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8331112c-4c73-4a3f-89ac-8a0a03bd889f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:25.054307 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8331112c-4c73-4a3f-89ac-8a0a03bd889f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:25.054781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8331112c-4c73-4a3f-89ac-8a0a03bd889f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:25.075445 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:25.187331 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0b15619a-2a86-45fd-9daf-b9271a47445d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:25.188012 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0b15619a-2a86-45fd-9daf-b9271a47445d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:25.196441 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b15619a-2a86-45fd-9daf-b9271a47445d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:25.198175 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b15619a-2a86-45fd-9daf-b9271a47445d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:25.199368 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b15619a-2a86-45fd-9daf-b9271a47445d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:25.199997 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0b15619a-2a86-45fd-9daf-b9271a47445d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:25.215365 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-8331112c-4c73-4a3f-89ac-8a0a03bd889f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:25.238629 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-8331112c-4c73-4a3f-89ac-8a0a03bd889f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.194980 Aug 03 12:14:25.239285 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 195/413] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:25 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:25.353639 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0b15619a-2a86-45fd-9daf-b9271a47445d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:25.361936 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0b15619a-2a86-45fd-9daf-b9271a47445d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:25.363474 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0b15619a-2a86-45fd-9daf-b9271a47445d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:25.364632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0b15619a-2a86-45fd-9daf-b9271a47445d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1752 microversion: 2.20 time: 0.182327 Aug 03 12:14:25.365189 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 219/414] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:25 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:14:25.614476 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-753b4ba6-5cc9-4e79-b5b0-bcdf0361fb8d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:25.615033 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-753b4ba6-5cc9-4e79-b5b0-bcdf0361fb8d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:25.621497 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-753b4ba6-5cc9-4e79-b5b0-bcdf0361fb8d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:25.621961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-753b4ba6-5cc9-4e79-b5b0-bcdf0361fb8d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:25.622774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-753b4ba6-5cc9-4e79-b5b0-bcdf0361fb8d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:25.623214 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-753b4ba6-5cc9-4e79-b5b0-bcdf0361fb8d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:25.653742 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-1759249c-76bd-4df7-ac2c-8a3459d42cd5 req-f5d39b51-f66e-4c65-bfac-2d4c762408c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692c1c3e-e3b3-4d9a-ac59-e82611208c18", "name": "network-vif-plugged", "status": "completed", "tag": "543f3e50-e8ff-49c4-bc9f-a59da69e215e"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:25.664792 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-1759249c-76bd-4df7-ac2c-8a3459d42cd5 req-f5d39b51-f66e-4c65-bfac-2d4c762408c2 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:25.665308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-1759249c-76bd-4df7-ac2c-8a3459d42cd5 req-f5d39b51-f66e-4c65-bfac-2d4c762408c2 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:25.681648 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-1759249c-76bd-4df7-ac2c-8a3459d42cd5 req-f5d39b51-f66e-4c65-bfac-2d4c762408c2 service nova] Creating event network-vif-plugged:543f3e50-e8ff-49c4-bc9f-a59da69e215e for instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 on hv-cinder-83602 Aug 03 12:14:25.687109 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-1759249c-76bd-4df7-ac2c-8a3459d42cd5 req-f5d39b51-f66e-4c65-bfac-2d4c762408c2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036959 Aug 03 12:14:25.688038 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 220/415] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:25.773497 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-753b4ba6-5cc9-4e79-b5b0-bcdf0361fb8d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:25.781519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-753b4ba6-5cc9-4e79-b5b0-bcdf0361fb8d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1548 microversion: 2.1 time: 0.171545 Aug 03 12:14:25.782480 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 196/416] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:25 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:25.806156 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cea0d47a-f8a3-403a-887a-7968aaa490c3 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:25.806891 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cea0d47a-f8a3-403a-887a-7968aaa490c3 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:25.813534 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cea0d47a-f8a3-403a-887a-7968aaa490c3 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:25.813985 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cea0d47a-f8a3-403a-887a-7968aaa490c3 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:25.814790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cea0d47a-f8a3-403a-887a-7968aaa490c3 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:25.815233 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cea0d47a-f8a3-403a-887a-7968aaa490c3 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:25.967308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cea0d47a-f8a3-403a-887a-7968aaa490c3 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:25.975220 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cea0d47a-f8a3-403a-887a-7968aaa490c3 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1548 microversion: 2.1 time: 0.173451 Aug 03 12:14:25.975806 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 221/417] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:25 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1548 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:25.997100 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a020ca1c-b6db-4e30-9d7e-e665209c5f99 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:26.003141 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a020ca1c-b6db-4e30-9d7e-e665209c5f99 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:26.003945 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a020ca1c-b6db-4e30-9d7e-e665209c5f99 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Searching by: {'deleted': False, 'project_id': '3156a99cf94e4845b22550fe2e064849'} {{(pid=117911) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 12:14:26.012286 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a020ca1c-b6db-4e30-9d7e-e665209c5f99 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:26.012743 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a020ca1c-b6db-4e30-9d7e-e665209c5f99 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:26.013620 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a020ca1c-b6db-4e30-9d7e-e665209c5f99 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:26.014061 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a020ca1c-b6db-4e30-9d7e-e665209c5f99 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:26.111309 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.multi_cell_list [None req-a020ca1c-b6db-4e30-9d7e-e665209c5f99 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117911) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 12:14:26.211177 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a020ca1c-b6db-4e30-9d7e-e665209c5f99 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.218758 Aug 03 12:14:26.211674 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 197/418] 10.222.0.17 () {58 vars in 1125 bytes} [Wed Aug 3 12:14:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:26.223474 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a31f5f01-6453-4b00-a8dc-f71735dd80e5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:26.224130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a31f5f01-6453-4b00-a8dc-f71735dd80e5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:26.230462 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a31f5f01-6453-4b00-a8dc-f71735dd80e5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:26.230917 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a31f5f01-6453-4b00-a8dc-f71735dd80e5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:26.231704 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a31f5f01-6453-4b00-a8dc-f71735dd80e5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:26.232119 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a31f5f01-6453-4b00-a8dc-f71735dd80e5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:26.264145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3f2a37eb-77ef-43e4-a468-d51405c64749 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:26.264912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-3f2a37eb-77ef-43e4-a468-d51405c64749 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:26.271868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3f2a37eb-77ef-43e4-a468-d51405c64749 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:26.272323 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3f2a37eb-77ef-43e4-a468-d51405c64749 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:26.273133 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3f2a37eb-77ef-43e4-a468-d51405c64749 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:26.273548 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3f2a37eb-77ef-43e4-a468-d51405c64749 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:26.397576 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a31f5f01-6453-4b00-a8dc-f71735dd80e5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:26.405077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a31f5f01-6453-4b00-a8dc-f71735dd80e5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1548 microversion: 2.1 time: 0.185481 Aug 03 12:14:26.405656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 222/419] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:26 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1548 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:26.410300 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ea35ff2b-f23e-46df-929d-436fcd5569da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:26.410939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ea35ff2b-f23e-46df-929d-436fcd5569da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:26.415489 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-3f2a37eb-77ef-43e4-a468-d51405c64749 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:26.418359 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ea35ff2b-f23e-46df-929d-436fcd5569da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:26.419059 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ea35ff2b-f23e-46df-929d-436fcd5569da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:26.419964 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ea35ff2b-f23e-46df-929d-436fcd5569da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:26.420293 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ea35ff2b-f23e-46df-929d-436fcd5569da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:26.428129 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-3f2a37eb-77ef-43e4-a468-d51405c64749 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.172287 Aug 03 12:14:26.429457 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 198/420] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:26 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:26.570245 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ea35ff2b-f23e-46df-929d-436fcd5569da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:26.580770 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ea35ff2b-f23e-46df-929d-436fcd5569da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:26.582304 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ea35ff2b-f23e-46df-929d-436fcd5569da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:26.583495 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ea35ff2b-f23e-46df-929d-436fcd5569da tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1752 microversion: 2.20 time: 0.176928 Aug 03 12:14:26.584054 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 223/421] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:26 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:27.452159 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2cbb0fa3-602d-4c36-a422-761930cdead6 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:27.453413 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2cbb0fa3-602d-4c36-a422-761930cdead6 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:27.462330 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2cbb0fa3-602d-4c36-a422-761930cdead6 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:27.463054 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2cbb0fa3-602d-4c36-a422-761930cdead6 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:27.463843 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2cbb0fa3-602d-4c36-a422-761930cdead6 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:27.464286 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2cbb0fa3-602d-4c36-a422-761930cdead6 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:27.612618 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-15d285db-d2e4-4ab8-9746-08a442fbc633 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:27.613742 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-15d285db-d2e4-4ab8-9746-08a442fbc633 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:27.625127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-15d285db-d2e4-4ab8-9746-08a442fbc633 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:27.625591 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-15d285db-d2e4-4ab8-9746-08a442fbc633 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:27.626133 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2cbb0fa3-602d-4c36-a422-761930cdead6 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:27.626382 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-15d285db-d2e4-4ab8-9746-08a442fbc633 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:27.626863 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-15d285db-d2e4-4ab8-9746-08a442fbc633 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:27.634929 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2cbb0fa3-602d-4c36-a422-761930cdead6 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1267 microversion: 2.1 time: 0.187722 Aug 03 12:14:27.635520 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 199/422] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:27 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:27.791302 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-15d285db-d2e4-4ab8-9746-08a442fbc633 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:27.808851 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-15d285db-d2e4-4ab8-9746-08a442fbc633 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:27.810693 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-15d285db-d2e4-4ab8-9746-08a442fbc633 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:27.811905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-15d285db-d2e4-4ab8-9746-08a442fbc633 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1752 microversion: 2.20 time: 0.207164 Aug 03 12:14:27.812874 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 224/423] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:27 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1752 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:28.019487 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-613afb35-7011-48dd-9265-f27cd4e6ab5d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab315102-5b54-448e-b8c6-6e29b011eb26"}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:28.021895 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-613afb35-7011-48dd-9265-f27cd4e6ab5d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:28.029347 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-613afb35-7011-48dd-9265-f27cd4e6ab5d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:28.029861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-613afb35-7011-48dd-9265-f27cd4e6ab5d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:28.031546 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-613afb35-7011-48dd-9265-f27cd4e6ab5d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:28.032061 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-613afb35-7011-48dd-9265-f27cd4e6ab5d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:28.658035 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b91fb9ce-fe48-440c-a1fb-ed12c333b9e2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:28.659053 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b91fb9ce-fe48-440c-a1fb-ed12c333b9e2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:28.668746 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b91fb9ce-fe48-440c-a1fb-ed12c333b9e2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:28.669198 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b91fb9ce-fe48-440c-a1fb-ed12c333b9e2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:28.669976 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b91fb9ce-fe48-440c-a1fb-ed12c333b9e2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:28.670414 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b91fb9ce-fe48-440c-a1fb-ed12c333b9e2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:28.823496 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b91fb9ce-fe48-440c-a1fb-ed12c333b9e2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:28.834407 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b91fb9ce-fe48-440c-a1fb-ed12c333b9e2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1454 microversion: 2.1 time: 0.180994 Aug 03 12:14:28.835253 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 225/424] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:28 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:28.844002 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-613afb35-7011-48dd-9265-f27cd4e6ab5d tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "POST /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.828651 Aug 03 12:14:28.847425 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 200/425] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:14:28 2022] POST /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments => generated 194 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:28.848717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3d50fa9c-9dd4-4d7e-94e9-4d2a38dc8b7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:28.849414 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3d50fa9c-9dd4-4d7e-94e9-4d2a38dc8b7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:28.855735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3d50fa9c-9dd4-4d7e-94e9-4d2a38dc8b7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:28.856267 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3d50fa9c-9dd4-4d7e-94e9-4d2a38dc8b7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:28.857112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3d50fa9c-9dd4-4d7e-94e9-4d2a38dc8b7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:28.857637 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3d50fa9c-9dd4-4d7e-94e9-4d2a38dc8b7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:28.864185 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-780e545a-18c9-4694-8c4f-8bf5cb23c5f0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:28.864881 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-780e545a-18c9-4694-8c4f-8bf5cb23c5f0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:28.871261 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-780e545a-18c9-4694-8c4f-8bf5cb23c5f0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:28.871978 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-780e545a-18c9-4694-8c4f-8bf5cb23c5f0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:28.872737 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-780e545a-18c9-4694-8c4f-8bf5cb23c5f0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:28.873160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-780e545a-18c9-4694-8c4f-8bf5cb23c5f0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:28.995614 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3d50fa9c-9dd4-4d7e-94e9-4d2a38dc8b7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:29.006012 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3d50fa9c-9dd4-4d7e-94e9-4d2a38dc8b7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:29.008120 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3d50fa9c-9dd4-4d7e-94e9-4d2a38dc8b7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:29.009307 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3d50fa9c-9dd4-4d7e-94e9-4d2a38dc8b7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1752 microversion: 2.20 time: 0.167282 Aug 03 12:14:29.009889 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 226/426] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:28 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:14:29.025085 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-780e545a-18c9-4694-8c4f-8bf5cb23c5f0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:29.038642 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-780e545a-18c9-4694-8c4f-8bf5cb23c5f0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1454 microversion: 2.1 time: 0.178510 Aug 03 12:14:29.039717 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 201/427] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:28 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:29.649685 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4a8584fe-aab7-4397-99de-a67a89944b1c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:29.662704 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4a8584fe-aab7-4397-99de-a67a89944b1c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:29.664054 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4a8584fe-aab7-4397-99de-a67a89944b1c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:29.792684 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4a8584fe-aab7-4397-99de-a67a89944b1c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Going to try to stop instance {{(pid=117910) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 12:14:29.922592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4a8584fe-aab7-4397-99de-a67a89944b1c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "POST /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/action" status: 202 len: 0 microversion: 2.1 time: 0.280116 Aug 03 12:14:29.930211 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 227/428] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:14:29 2022] POST /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:14:29.951926 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5843eda2-9276-40d6-bfee-81ee225cbaf1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:29.953106 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5843eda2-9276-40d6-bfee-81ee225cbaf1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:29.968534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5843eda2-9276-40d6-bfee-81ee225cbaf1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:29.968534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5843eda2-9276-40d6-bfee-81ee225cbaf1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:29.969042 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5843eda2-9276-40d6-bfee-81ee225cbaf1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:29.969456 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5843eda2-9276-40d6-bfee-81ee225cbaf1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:30.047814 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e6b4447c-14a2-403c-a486-04a4d962a39a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:30.048995 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e6b4447c-14a2-403c-a486-04a4d962a39a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:30.057240 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e6b4447c-14a2-403c-a486-04a4d962a39a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:30.061090 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e6b4447c-14a2-403c-a486-04a4d962a39a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:30.063695 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e6b4447c-14a2-403c-a486-04a4d962a39a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:30.067632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e6b4447c-14a2-403c-a486-04a4d962a39a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:30.121759 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5843eda2-9276-40d6-bfee-81ee225cbaf1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:30.131197 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5843eda2-9276-40d6-bfee-81ee225cbaf1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.201034 Aug 03 12:14:30.132249 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 202/429] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:29 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:30.319117 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e6b4447c-14a2-403c-a486-04a4d962a39a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:30.332416 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e6b4447c-14a2-403c-a486-04a4d962a39a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:30.333982 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e6b4447c-14a2-403c-a486-04a4d962a39a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:30.335938 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e6b4447c-14a2-403c-a486-04a4d962a39a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1752 microversion: 2.20 time: 0.297880 Aug 03 12:14:30.336515 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 228/430] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:30 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1752 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:31.153096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-acd3bfb7-5a64-4cc7-a678-7e31505cde4b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:31.154358 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-acd3bfb7-5a64-4cc7-a678-7e31505cde4b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:31.161350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-acd3bfb7-5a64-4cc7-a678-7e31505cde4b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:31.161920 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-acd3bfb7-5a64-4cc7-a678-7e31505cde4b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:31.162965 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-acd3bfb7-5a64-4cc7-a678-7e31505cde4b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:31.164038 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-acd3bfb7-5a64-4cc7-a678-7e31505cde4b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:31.323144 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-3c6516ae-763f-47ec-8b3b-855dd3c421f4 req-d3ffd2d9-ce6b-4247-a109-fe119b6e84c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692c1c3e-e3b3-4d9a-ac59-e82611208c18", "tag": "543f3e50-e8ff-49c4-bc9f-a59da69e215e"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:31.333254 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-3c6516ae-763f-47ec-8b3b-855dd3c421f4 req-d3ffd2d9-ce6b-4247-a109-fe119b6e84c0 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:31.333688 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-3c6516ae-763f-47ec-8b3b-855dd3c421f4 req-d3ffd2d9-ce6b-4247-a109-fe119b6e84c0 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:31.346378 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-3c6516ae-763f-47ec-8b3b-855dd3c421f4 req-d3ffd2d9-ce6b-4247-a109-fe119b6e84c0 service nova] Creating event network-changed:543f3e50-e8ff-49c4-bc9f-a59da69e215e for instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 on hv-cinder-83602 Aug 03 12:14:31.352687 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-3c6516ae-763f-47ec-8b3b-855dd3c421f4 req-d3ffd2d9-ce6b-4247-a109-fe119b6e84c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032925 Aug 03 12:14:31.353874 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 229/431] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:14:31.360584 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a82df111-779f-4e6a-87a7-9dae2c4871f6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:31.361306 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a82df111-779f-4e6a-87a7-9dae2c4871f6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:31.368934 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a82df111-779f-4e6a-87a7-9dae2c4871f6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:31.369398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a82df111-779f-4e6a-87a7-9dae2c4871f6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:31.370393 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a82df111-779f-4e6a-87a7-9dae2c4871f6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:31.370998 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a82df111-779f-4e6a-87a7-9dae2c4871f6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:31.387624 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-acd3bfb7-5a64-4cc7-a678-7e31505cde4b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:31.399816 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-acd3bfb7-5a64-4cc7-a678-7e31505cde4b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.249790 Aug 03 12:14:31.402225 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 203/432] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:31 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:31.557522 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a82df111-779f-4e6a-87a7-9dae2c4871f6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:31.568606 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a82df111-779f-4e6a-87a7-9dae2c4871f6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:31.570298 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a82df111-779f-4e6a-87a7-9dae2c4871f6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:31.572140 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a82df111-779f-4e6a-87a7-9dae2c4871f6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.216610 Aug 03 12:14:31.572739 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 230/433] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:31 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:32.430884 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-63e554ca-c0a9-4ae7-8ba8-2b2ea3cde76a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:32.431526 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-63e554ca-c0a9-4ae7-8ba8-2b2ea3cde76a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:32.438595 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-63e554ca-c0a9-4ae7-8ba8-2b2ea3cde76a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:32.439047 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-63e554ca-c0a9-4ae7-8ba8-2b2ea3cde76a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:32.440042 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-63e554ca-c0a9-4ae7-8ba8-2b2ea3cde76a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:32.440260 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-63e554ca-c0a9-4ae7-8ba8-2b2ea3cde76a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:32.596319 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9aeefade-3010-4e97-9f71-b6dd8ea84ac8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:32.597683 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9aeefade-3010-4e97-9f71-b6dd8ea84ac8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:32.607323 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9aeefade-3010-4e97-9f71-b6dd8ea84ac8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:32.607860 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9aeefade-3010-4e97-9f71-b6dd8ea84ac8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:32.608595 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9aeefade-3010-4e97-9f71-b6dd8ea84ac8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:32.609224 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9aeefade-3010-4e97-9f71-b6dd8ea84ac8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:32.615092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-63e554ca-c0a9-4ae7-8ba8-2b2ea3cde76a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:32.632881 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-63e554ca-c0a9-4ae7-8ba8-2b2ea3cde76a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.212391 Aug 03 12:14:32.635216 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 204/434] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:32 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:32.774107 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9aeefade-3010-4e97-9f71-b6dd8ea84ac8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:32.786125 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9aeefade-3010-4e97-9f71-b6dd8ea84ac8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:32.788207 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9aeefade-3010-4e97-9f71-b6dd8ea84ac8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:32.789950 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9aeefade-3010-4e97-9f71-b6dd8ea84ac8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.197598 Aug 03 12:14:32.790556 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 231/435] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:32 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:14:33.655706 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7b716aa9-17b8-488e-b204-235c7eadb671 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:33.656386 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7b716aa9-17b8-488e-b204-235c7eadb671 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:33.663367 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7b716aa9-17b8-488e-b204-235c7eadb671 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:33.663790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7b716aa9-17b8-488e-b204-235c7eadb671 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:33.664579 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7b716aa9-17b8-488e-b204-235c7eadb671 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:33.665012 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7b716aa9-17b8-488e-b204-235c7eadb671 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:33.817192 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0a68fa82-3cbb-4276-a6ce-1cb4e45818a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:33.818092 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0a68fa82-3cbb-4276-a6ce-1cb4e45818a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:33.824242 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7b716aa9-17b8-488e-b204-235c7eadb671 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:33.825796 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0a68fa82-3cbb-4276-a6ce-1cb4e45818a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:33.826243 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0a68fa82-3cbb-4276-a6ce-1cb4e45818a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:33.832687 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0a68fa82-3cbb-4276-a6ce-1cb4e45818a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:33.832954 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0a68fa82-3cbb-4276-a6ce-1cb4e45818a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:33.834064 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7b716aa9-17b8-488e-b204-235c7eadb671 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.182248 Aug 03 12:14:33.834689 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 205/436] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:33 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:33.993920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0a68fa82-3cbb-4276-a6ce-1cb4e45818a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:34.003093 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0a68fa82-3cbb-4276-a6ce-1cb4e45818a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:34.004621 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0a68fa82-3cbb-4276-a6ce-1cb4e45818a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:34.005912 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0a68fa82-3cbb-4276-a6ce-1cb4e45818a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.192822 Aug 03 12:14:34.006401 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 232/437] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:33 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:34.856668 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c9685a61-1f76-4b60-9a7e-30b3625af10a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:34.857314 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-c9685a61-1f76-4b60-9a7e-30b3625af10a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:34.864163 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c9685a61-1f76-4b60-9a7e-30b3625af10a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:34.864612 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c9685a61-1f76-4b60-9a7e-30b3625af10a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:34.865395 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c9685a61-1f76-4b60-9a7e-30b3625af10a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:34.865833 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c9685a61-1f76-4b60-9a7e-30b3625af10a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:35.023746 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-c9685a61-1f76-4b60-9a7e-30b3625af10a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:35.031441 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-17981db0-4fc5-4aa9-81e6-3eb8789951a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:35.032310 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-17981db0-4fc5-4aa9-81e6-3eb8789951a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:35.040010 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c9685a61-1f76-4b60-9a7e-30b3625af10a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.187127 Aug 03 12:14:35.040476 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17981db0-4fc5-4aa9-81e6-3eb8789951a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:35.041092 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17981db0-4fc5-4aa9-81e6-3eb8789951a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:35.055704 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17981db0-4fc5-4aa9-81e6-3eb8789951a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:35.055704 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-17981db0-4fc5-4aa9-81e6-3eb8789951a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:35.056960 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 206/438] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:34 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:35.074367 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:35.247424 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-17981db0-4fc5-4aa9-81e6-3eb8789951a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:35.257725 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-17981db0-4fc5-4aa9-81e6-3eb8789951a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:35.259733 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-17981db0-4fc5-4aa9-81e6-3eb8789951a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:35.260988 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-17981db0-4fc5-4aa9-81e6-3eb8789951a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.235121 Aug 03 12:14:35.261752 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 233/439] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:35 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:14:36.063045 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b300dab2-12fe-4cb2-a828-a20b22ad46d2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:36.064371 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b300dab2-12fe-4cb2-a828-a20b22ad46d2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:36.071620 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:36.074584 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b300dab2-12fe-4cb2-a828-a20b22ad46d2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:36.075602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b300dab2-12fe-4cb2-a828-a20b22ad46d2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:36.076690 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b300dab2-12fe-4cb2-a828-a20b22ad46d2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:36.077395 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b300dab2-12fe-4cb2-a828-a20b22ad46d2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:36.230886 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b300dab2-12fe-4cb2-a828-a20b22ad46d2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:36.239279 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b300dab2-12fe-4cb2-a828-a20b22ad46d2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.180283 Aug 03 12:14:36.240165 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 207/440] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:36 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:36.285290 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c34a0b81-5eee-46a3-9761-4e1d16d0e6f2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:36.285888 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c34a0b81-5eee-46a3-9761-4e1d16d0e6f2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:36.288505 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=94 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:36.293512 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c34a0b81-5eee-46a3-9761-4e1d16d0e6f2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:36.294213 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c34a0b81-5eee-46a3-9761-4e1d16d0e6f2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:36.295191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c34a0b81-5eee-46a3-9761-4e1d16d0e6f2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:36.295786 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c34a0b81-5eee-46a3-9761-4e1d16d0e6f2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:36.439740 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c34a0b81-5eee-46a3-9761-4e1d16d0e6f2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:36.448929 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c34a0b81-5eee-46a3-9761-4e1d16d0e6f2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:36.450298 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c34a0b81-5eee-46a3-9761-4e1d16d0e6f2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:36.451522 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c34a0b81-5eee-46a3-9761-4e1d16d0e6f2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.170152 Aug 03 12:14:36.452099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 234/441] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:36 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:37.261407 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a9e2c511-9840-4b32-bd9a-0dce544d6125 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:37.263767 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a9e2c511-9840-4b32-bd9a-0dce544d6125 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:37.269453 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a9e2c511-9840-4b32-bd9a-0dce544d6125 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:37.269918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a9e2c511-9840-4b32-bd9a-0dce544d6125 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:37.270804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a9e2c511-9840-4b32-bd9a-0dce544d6125 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:37.271252 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a9e2c511-9840-4b32-bd9a-0dce544d6125 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:37.418801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a9e2c511-9840-4b32-bd9a-0dce544d6125 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:37.428371 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a9e2c511-9840-4b32-bd9a-0dce544d6125 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.170780 Aug 03 12:14:37.428958 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 208/442] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:37 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:37.475564 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a4b79564-754a-46d2-a491-1a19ccdc758a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:37.477048 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a4b79564-754a-46d2-a491-1a19ccdc758a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:37.484726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a4b79564-754a-46d2-a491-1a19ccdc758a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:37.484726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a4b79564-754a-46d2-a491-1a19ccdc758a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:37.485807 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a4b79564-754a-46d2-a491-1a19ccdc758a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:37.485807 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a4b79564-754a-46d2-a491-1a19ccdc758a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:37.656595 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a4b79564-754a-46d2-a491-1a19ccdc758a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:37.665616 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a4b79564-754a-46d2-a491-1a19ccdc758a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:37.667157 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a4b79564-754a-46d2-a491-1a19ccdc758a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:37.668347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a4b79564-754a-46d2-a491-1a19ccdc758a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.196896 Aug 03 12:14:37.668915 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 235/443] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:37 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:38.464395 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-dfd8ef86-d7ef-46a3-815d-0bb6d480a69a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:38.465040 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-dfd8ef86-d7ef-46a3-815d-0bb6d480a69a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:38.467608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:38.474270 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dfd8ef86-d7ef-46a3-815d-0bb6d480a69a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:38.474750 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dfd8ef86-d7ef-46a3-815d-0bb6d480a69a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:38.475536 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dfd8ef86-d7ef-46a3-815d-0bb6d480a69a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:38.475969 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dfd8ef86-d7ef-46a3-815d-0bb6d480a69a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:38.645905 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dfd8ef86-d7ef-46a3-815d-0bb6d480a69a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:38.659568 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-dfd8ef86-d7ef-46a3-815d-0bb6d480a69a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.198650 Aug 03 12:14:38.660583 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 209/444] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:38 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:38.703783 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2351f868-a235-41b9-8cb9-21f6ccfac83c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:38.705056 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2351f868-a235-41b9-8cb9-21f6ccfac83c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:38.717531 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2351f868-a235-41b9-8cb9-21f6ccfac83c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:38.718623 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2351f868-a235-41b9-8cb9-21f6ccfac83c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:38.720044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2351f868-a235-41b9-8cb9-21f6ccfac83c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:38.720880 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2351f868-a235-41b9-8cb9-21f6ccfac83c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:38.908253 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2351f868-a235-41b9-8cb9-21f6ccfac83c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:38.917861 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2351f868-a235-41b9-8cb9-21f6ccfac83c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:38.919409 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2351f868-a235-41b9-8cb9-21f6ccfac83c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:38.920715 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2351f868-a235-41b9-8cb9-21f6ccfac83c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.224727 Aug 03 12:14:38.921389 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 236/445] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:38 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:39.685564 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b90dee7c-1b92-4ab6-b3eb-f05d49927f4f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:39.687713 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b90dee7c-1b92-4ab6-b3eb-f05d49927f4f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:39.699129 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b90dee7c-1b92-4ab6-b3eb-f05d49927f4f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:39.699785 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b90dee7c-1b92-4ab6-b3eb-f05d49927f4f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:39.700750 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b90dee7c-1b92-4ab6-b3eb-f05d49927f4f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:39.701334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b90dee7c-1b92-4ab6-b3eb-f05d49927f4f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:39.734313 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:39.863446 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b90dee7c-1b92-4ab6-b3eb-f05d49927f4f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:39.871597 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b90dee7c-1b92-4ab6-b3eb-f05d49927f4f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.191319 Aug 03 12:14:39.872168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 210/446] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:39 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:39.944717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-adc8b57d-699c-4ba5-9325-bf343603a507 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:39.946082 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-adc8b57d-699c-4ba5-9325-bf343603a507 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:39.953164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-adc8b57d-699c-4ba5-9325-bf343603a507 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:39.953938 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-adc8b57d-699c-4ba5-9325-bf343603a507 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:39.954965 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-adc8b57d-699c-4ba5-9325-bf343603a507 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:39.955410 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-adc8b57d-699c-4ba5-9325-bf343603a507 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:40.098061 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-adc8b57d-699c-4ba5-9325-bf343603a507 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:40.106642 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-adc8b57d-699c-4ba5-9325-bf343603a507 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:40.108188 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-adc8b57d-699c-4ba5-9325-bf343603a507 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:40.109347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-adc8b57d-699c-4ba5-9325-bf343603a507 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.168693 Aug 03 12:14:40.109903 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 237/447] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:39 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:40.893118 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5b18ff4b-0b76-4c03-a3d8-263e4638e701 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:40.894993 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5b18ff4b-0b76-4c03-a3d8-263e4638e701 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:40.902226 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5b18ff4b-0b76-4c03-a3d8-263e4638e701 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:40.902803 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5b18ff4b-0b76-4c03-a3d8-263e4638e701 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:40.903677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5b18ff4b-0b76-4c03-a3d8-263e4638e701 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:40.904172 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5b18ff4b-0b76-4c03-a3d8-263e4638e701 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:41.041857 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5b18ff4b-0b76-4c03-a3d8-263e4638e701 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:41.050210 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5b18ff4b-0b76-4c03-a3d8-263e4638e701 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.161039 Aug 03 12:14:41.051050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 211/448] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:40 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:41.133286 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d75d4bfa-83bf-4fc8-9850-e31f7da370fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:41.133955 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d75d4bfa-83bf-4fc8-9850-e31f7da370fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:41.141230 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d75d4bfa-83bf-4fc8-9850-e31f7da370fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:41.141693 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d75d4bfa-83bf-4fc8-9850-e31f7da370fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:41.142828 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d75d4bfa-83bf-4fc8-9850-e31f7da370fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:41.143278 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d75d4bfa-83bf-4fc8-9850-e31f7da370fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:41.302808 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d75d4bfa-83bf-4fc8-9850-e31f7da370fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:41.313590 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d75d4bfa-83bf-4fc8-9850-e31f7da370fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:41.316218 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d75d4bfa-83bf-4fc8-9850-e31f7da370fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:41.317424 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d75d4bfa-83bf-4fc8-9850-e31f7da370fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.188168 Aug 03 12:14:41.318193 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 238/449] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:41 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:42.072947 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-49762449-18ce-49a3-b33d-873f352b27ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:42.073599 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-49762449-18ce-49a3-b33d-873f352b27ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:42.081291 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-49762449-18ce-49a3-b33d-873f352b27ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:42.081741 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-49762449-18ce-49a3-b33d-873f352b27ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:42.082550 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-49762449-18ce-49a3-b33d-873f352b27ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:42.082996 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-49762449-18ce-49a3-b33d-873f352b27ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:42.232534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-49762449-18ce-49a3-b33d-873f352b27ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:42.242509 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-49762449-18ce-49a3-b33d-873f352b27ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.173946 Aug 03 12:14:42.243147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 212/450] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:42 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:42.341588 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-82cac458-8dcd-4a79-b30a-913c74a99718 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:42.342210 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-82cac458-8dcd-4a79-b30a-913c74a99718 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:42.348807 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-82cac458-8dcd-4a79-b30a-913c74a99718 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:42.349261 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-82cac458-8dcd-4a79-b30a-913c74a99718 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:42.350026 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-82cac458-8dcd-4a79-b30a-913c74a99718 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:42.351011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-82cac458-8dcd-4a79-b30a-913c74a99718 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:42.488696 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-82cac458-8dcd-4a79-b30a-913c74a99718 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:42.497941 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-82cac458-8dcd-4a79-b30a-913c74a99718 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:42.499490 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-82cac458-8dcd-4a79-b30a-913c74a99718 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:42.500676 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-82cac458-8dcd-4a79-b30a-913c74a99718 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.163023 Aug 03 12:14:42.501234 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 239/451] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:42 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:43.277895 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-573cb042-512f-4ce4-b873-e786adda8997 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:43.279145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-573cb042-512f-4ce4-b873-e786adda8997 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:43.289983 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-573cb042-512f-4ce4-b873-e786adda8997 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:43.290468 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-573cb042-512f-4ce4-b873-e786adda8997 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:43.291258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-573cb042-512f-4ce4-b873-e786adda8997 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:43.291694 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-573cb042-512f-4ce4-b873-e786adda8997 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:43.440288 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-573cb042-512f-4ce4-b873-e786adda8997 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:43.449735 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-573cb042-512f-4ce4-b873-e786adda8997 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.179005 Aug 03 12:14:43.450336 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 213/452] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:43 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:43.524350 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2209598b-dbb9-4d09-a1cf-066631c67437 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:43.524964 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2209598b-dbb9-4d09-a1cf-066631c67437 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:43.531692 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2209598b-dbb9-4d09-a1cf-066631c67437 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:43.532067 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2209598b-dbb9-4d09-a1cf-066631c67437 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:43.532838 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2209598b-dbb9-4d09-a1cf-066631c67437 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:43.533279 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2209598b-dbb9-4d09-a1cf-066631c67437 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:43.674876 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2209598b-dbb9-4d09-a1cf-066631c67437 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:43.684178 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2209598b-dbb9-4d09-a1cf-066631c67437 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:43.685693 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2209598b-dbb9-4d09-a1cf-066631c67437 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:43.686921 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2209598b-dbb9-4d09-a1cf-066631c67437 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.166545 Aug 03 12:14:43.687481 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 240/453] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:43 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:44.473361 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-87407fb6-3a72-4fdb-ae91-b1af3a6c222a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:44.474066 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-87407fb6-3a72-4fdb-ae91-b1af3a6c222a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:44.482258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87407fb6-3a72-4fdb-ae91-b1af3a6c222a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:44.482737 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87407fb6-3a72-4fdb-ae91-b1af3a6c222a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:44.483908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87407fb6-3a72-4fdb-ae91-b1af3a6c222a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:44.484048 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87407fb6-3a72-4fdb-ae91-b1af3a6c222a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:44.649114 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-87407fb6-3a72-4fdb-ae91-b1af3a6c222a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:44.657961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-87407fb6-3a72-4fdb-ae91-b1af3a6c222a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.188872 Aug 03 12:14:44.658685 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 214/454] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:44 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:44.711774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-821ffecf-cb24-41c6-be90-2170f9ff208f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:44.712398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-821ffecf-cb24-41c6-be90-2170f9ff208f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:44.719394 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-821ffecf-cb24-41c6-be90-2170f9ff208f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:44.719852 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-821ffecf-cb24-41c6-be90-2170f9ff208f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:44.720646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-821ffecf-cb24-41c6-be90-2170f9ff208f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:44.721088 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-821ffecf-cb24-41c6-be90-2170f9ff208f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:44.879210 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-821ffecf-cb24-41c6-be90-2170f9ff208f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:44.890677 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-821ffecf-cb24-41c6-be90-2170f9ff208f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:44.892258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-821ffecf-cb24-41c6-be90-2170f9ff208f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:44.893734 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-821ffecf-cb24-41c6-be90-2170f9ff208f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.186411 Aug 03 12:14:44.894317 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 241/455] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:44 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:45.680387 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c87c566b-25b1-446e-94f0-cc3450af23c1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:45.681045 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-c87c566b-25b1-446e-94f0-cc3450af23c1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:45.689193 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c87c566b-25b1-446e-94f0-cc3450af23c1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:45.689973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c87c566b-25b1-446e-94f0-cc3450af23c1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:45.691350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c87c566b-25b1-446e-94f0-cc3450af23c1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:45.692136 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c87c566b-25b1-446e-94f0-cc3450af23c1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:45.881471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-c87c566b-25b1-446e-94f0-cc3450af23c1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:45.891038 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c87c566b-25b1-446e-94f0-cc3450af23c1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.214471 Aug 03 12:14:45.891852 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 215/456] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:45 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:45.917539 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-64b3d1ce-af5c-48a3-a87b-7c3efe0bfdc1 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:45.918146 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-64b3d1ce-af5c-48a3-a87b-7c3efe0bfdc1 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:45.925365 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-64b3d1ce-af5c-48a3-a87b-7c3efe0bfdc1 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:45.925808 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-64b3d1ce-af5c-48a3-a87b-7c3efe0bfdc1 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:45.926654 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-64b3d1ce-af5c-48a3-a87b-7c3efe0bfdc1 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:45.927098 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-64b3d1ce-af5c-48a3-a87b-7c3efe0bfdc1 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:46.076875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-64b3d1ce-af5c-48a3-a87b-7c3efe0bfdc1 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:46.088317 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-64b3d1ce-af5c-48a3-a87b-7c3efe0bfdc1 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:46.089827 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-64b3d1ce-af5c-48a3-a87b-7c3efe0bfdc1 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:46.091061 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-64b3d1ce-af5c-48a3-a87b-7c3efe0bfdc1 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.178287 Aug 03 12:14:46.091635 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 242/457] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:45 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:46.265201 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-512feb94-ae0b-4b06-8922-aa3b3d59f5e1 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:46.265822 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-512feb94-ae0b-4b06-8922-aa3b3d59f5e1 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:46.273545 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-512feb94-ae0b-4b06-8922-aa3b3d59f5e1 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:46.273993 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-512feb94-ae0b-4b06-8922-aa3b3d59f5e1 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:46.274936 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-512feb94-ae0b-4b06-8922-aa3b3d59f5e1 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:46.275269 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-512feb94-ae0b-4b06-8922-aa3b3d59f5e1 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:46.420361 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-512feb94-ae0b-4b06-8922-aa3b3d59f5e1 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:46.429079 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-512feb94-ae0b-4b06-8922-aa3b3d59f5e1 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1594 microversion: 2.1 time: 0.167557 Aug 03 12:14:46.429655 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 216/458] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:46 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1594 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:46.914205 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7797c33d-f22b-426e-9cd8-74a4aac7475f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:46.914861 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7797c33d-f22b-426e-9cd8-74a4aac7475f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:46.920729 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7797c33d-f22b-426e-9cd8-74a4aac7475f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:46.921313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7797c33d-f22b-426e-9cd8-74a4aac7475f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:46.921910 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7797c33d-f22b-426e-9cd8-74a4aac7475f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:46.922342 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7797c33d-f22b-426e-9cd8-74a4aac7475f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:47.114010 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5a129566-9acb-49b8-a8fa-b2a31c0fbadc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:47.114745 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5a129566-9acb-49b8-a8fa-b2a31c0fbadc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:47.122384 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5a129566-9acb-49b8-a8fa-b2a31c0fbadc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:47.122616 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5a129566-9acb-49b8-a8fa-b2a31c0fbadc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:47.123574 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5a129566-9acb-49b8-a8fa-b2a31c0fbadc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:47.123951 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5a129566-9acb-49b8-a8fa-b2a31c0fbadc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:47.193074 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7797c33d-f22b-426e-9cd8-74a4aac7475f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:47.203087 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7797c33d-f22b-426e-9cd8-74a4aac7475f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.292685 Aug 03 12:14:47.219409 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 243/459] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:46 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:47.330147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5a129566-9acb-49b8-a8fa-b2a31c0fbadc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:47.340347 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5a129566-9acb-49b8-a8fa-b2a31c0fbadc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:47.341887 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5a129566-9acb-49b8-a8fa-b2a31c0fbadc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:47.343139 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5a129566-9acb-49b8-a8fa-b2a31c0fbadc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.233135 Aug 03 12:14:47.343914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 217/460] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:47 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:14:48.225128 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0c68b132-5fc6-49be-b45a-3542e2a15b32 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:48.225857 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0c68b132-5fc6-49be-b45a-3542e2a15b32 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:48.232607 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0c68b132-5fc6-49be-b45a-3542e2a15b32 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:48.233051 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0c68b132-5fc6-49be-b45a-3542e2a15b32 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:48.233824 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0c68b132-5fc6-49be-b45a-3542e2a15b32 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:48.234257 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0c68b132-5fc6-49be-b45a-3542e2a15b32 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:48.341272 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-0a06dbe3-2bc3-4f79-b310-8e8e669bbb43 req-fd73f38d-4637-47f8-aa3b-343210a68294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ef0b56c-b712-49ca-8847-a0acbc0a729a", "tag": "c2052327-4535-436a-9914-53604665eddd"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:48.354044 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-0a06dbe3-2bc3-4f79-b310-8e8e669bbb43 req-fd73f38d-4637-47f8-aa3b-343210a68294 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:48.354525 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-0a06dbe3-2bc3-4f79-b310-8e8e669bbb43 req-fd73f38d-4637-47f8-aa3b-343210a68294 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:48.370042 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-0a06dbe3-2bc3-4f79-b310-8e8e669bbb43 req-fd73f38d-4637-47f8-aa3b-343210a68294 service nova] Creating event network-changed:c2052327-4535-436a-9914-53604665eddd for instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a on hv-cinder-83602 Aug 03 12:14:48.378435 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-0a06dbe3-2bc3-4f79-b310-8e8e669bbb43 req-fd73f38d-4637-47f8-aa3b-343210a68294 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043434 Aug 03 12:14:48.379743 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 218/461] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:14:48.390847 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-998aeaca-4f32-4d33-9210-53fb517b1e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:48.391866 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-998aeaca-4f32-4d33-9210-53fb517b1e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:48.399714 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-998aeaca-4f32-4d33-9210-53fb517b1e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:48.400221 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-998aeaca-4f32-4d33-9210-53fb517b1e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:48.401014 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-998aeaca-4f32-4d33-9210-53fb517b1e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:48.401680 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-998aeaca-4f32-4d33-9210-53fb517b1e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:48.412377 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0c68b132-5fc6-49be-b45a-3542e2a15b32 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:48.450726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0c68b132-5fc6-49be-b45a-3542e2a15b32 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1721 microversion: 2.1 time: 0.227320 Aug 03 12:14:48.453920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 244/462] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:48 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:48.783540 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-998aeaca-4f32-4d33-9210-53fb517b1e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:48.796211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-998aeaca-4f32-4d33-9210-53fb517b1e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:48.797726 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-998aeaca-4f32-4d33-9210-53fb517b1e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:48.798944 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-998aeaca-4f32-4d33-9210-53fb517b1e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.417940 Aug 03 12:14:48.802314 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 219/463] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:48 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:49.480507 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-410259e7-16f3-4158-8d29-84e1e3bdd5a3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:49.480507 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-410259e7-16f3-4158-8d29-84e1e3bdd5a3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:49.485671 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-410259e7-16f3-4158-8d29-84e1e3bdd5a3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:49.486173 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-410259e7-16f3-4158-8d29-84e1e3bdd5a3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:49.487002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-410259e7-16f3-4158-8d29-84e1e3bdd5a3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:49.487483 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-410259e7-16f3-4158-8d29-84e1e3bdd5a3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:49.648019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ed52b4ab-f9a0-449e-920a-0b2bdcc3c636 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-880212409"}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:49.648708 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-ed52b4ab-f9a0-449e-920a-0b2bdcc3c636 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:49.658365 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ed52b4ab-f9a0-449e-920a-0b2bdcc3c636 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:49.658850 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ed52b4ab-f9a0-449e-920a-0b2bdcc3c636 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:49.659655 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ed52b4ab-f9a0-449e-920a-0b2bdcc3c636 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:49.659866 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-410259e7-16f3-4158-8d29-84e1e3bdd5a3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:49.660085 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ed52b4ab-f9a0-449e-920a-0b2bdcc3c636 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:49.670724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-410259e7-16f3-4158-8d29-84e1e3bdd5a3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1698 microversion: 2.1 time: 0.200784 Aug 03 12:14:49.671807 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 245/464] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:49 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1698 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:49.694982 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-593c2523-7e83-4eef-ad53-18be56861aaa tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:49.701235 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-593c2523-7e83-4eef-ad53-18be56861aaa tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:49.701757 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-593c2523-7e83-4eef-ad53-18be56861aaa tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:49.724375 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-593c2523-7e83-4eef-ad53-18be56861aaa tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Going to try to start instance {{(pid=117910) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 12:14:49.769388 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-593c2523-7e83-4eef-ad53-18be56861aaa tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "POST /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/action" status: 202 len: 0 microversion: 2.1 time: 0.078488 Aug 03 12:14:49.769985 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 246/465] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:14:49 2022] POST /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:14:49.778361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-41a78f82-f10c-4ec7-b236-77761ea3987b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:49.779094 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-41a78f82-f10c-4ec7-b236-77761ea3987b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:49.785295 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-41a78f82-f10c-4ec7-b236-77761ea3987b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:49.785748 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-41a78f82-f10c-4ec7-b236-77761ea3987b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:49.786541 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-41a78f82-f10c-4ec7-b236-77761ea3987b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:49.786979 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-41a78f82-f10c-4ec7-b236-77761ea3987b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:49.804976 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.network.security_group_api [None req-ed52b4ab-f9a0-449e-920a-0b2bdcc3c636 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Adding security group b22bf39c-286a-4d7b-82a8-7564288dea1b to port c2052327-4535-436a-9914-53604665eddd Aug 03 12:14:49.930432 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-41a78f82-f10c-4ec7-b236-77761ea3987b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:49.939515 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-41a78f82-f10c-4ec7-b236-77761ea3987b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1707 microversion: 2.1 time: 0.165048 Aug 03 12:14:49.940107 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 247/466] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:49 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1707 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:49.947219 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-03aa6504-c80d-461b-bacf-c6953da05cc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:49.947756 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-03aa6504-c80d-461b-bacf-c6953da05cc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:49.957306 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03aa6504-c80d-461b-bacf-c6953da05cc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:49.958071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03aa6504-c80d-461b-bacf-c6953da05cc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:49.959359 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03aa6504-c80d-461b-bacf-c6953da05cc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:49.959359 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03aa6504-c80d-461b-bacf-c6953da05cc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:50.117919 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-03aa6504-c80d-461b-bacf-c6953da05cc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:50.127401 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-03aa6504-c80d-461b-bacf-c6953da05cc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:50.129165 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-03aa6504-c80d-461b-bacf-c6953da05cc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:50.130514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-03aa6504-c80d-461b-bacf-c6953da05cc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.187759 Aug 03 12:14:50.131185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 248/467] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:49 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:50.170044 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ed52b4ab-f9a0-449e-920a-0b2bdcc3c636 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "POST /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/action" status: 202 len: 0 microversion: 2.1 time: 0.524168 Aug 03 12:14:50.177579 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 220/468] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:14:49 2022] POST /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 12:14:50.177798 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-50d6c201-181c-4247-af5c-2885801621b8 req-0408bdfb-568b-4b3b-b291-c0dabf85fefa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ef0b56c-b712-49ca-8847-a0acbc0a729a", "tag": "c2052327-4535-436a-9914-53604665eddd"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:50.183724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1947fdc1-1541-4ab8-909f-a95fda129548 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:50.184008 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1947fdc1-1541-4ab8-909f-a95fda129548 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:50.189861 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-50d6c201-181c-4247-af5c-2885801621b8 req-0408bdfb-568b-4b3b-b291-c0dabf85fefa service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:50.190414 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-50d6c201-181c-4247-af5c-2885801621b8 req-0408bdfb-568b-4b3b-b291-c0dabf85fefa service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:50.196617 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:14:50.202686 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1947fdc1-1541-4ab8-909f-a95fda129548 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:50.205573 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-50d6c201-181c-4247-af5c-2885801621b8 req-0408bdfb-568b-4b3b-b291-c0dabf85fefa service nova] Creating event network-changed:c2052327-4535-436a-9914-53604665eddd for instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a on hv-cinder-83602 Aug 03 12:14:50.206402 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1947fdc1-1541-4ab8-909f-a95fda129548 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:50.210573 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1947fdc1-1541-4ab8-909f-a95fda129548 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:50.211174 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1947fdc1-1541-4ab8-909f-a95fda129548 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:50.211567 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-50d6c201-181c-4247-af5c-2885801621b8 req-0408bdfb-568b-4b3b-b291-c0dabf85fefa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040766 Aug 03 12:14:50.212142 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 249/469] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:14:50.404388 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1947fdc1-1541-4ab8-909f-a95fda129548 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:50.415631 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1947fdc1-1541-4ab8-909f-a95fda129548 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1758 microversion: 2.1 time: 0.236473 Aug 03 12:14:50.416622 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 221/470] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:50 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1758 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:50.973671 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b6bf042a-c915-4243-8a87-f552ec58d8ea tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:50.974369 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b6bf042a-c915-4243-8a87-f552ec58d8ea tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:50.984019 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b6bf042a-c915-4243-8a87-f552ec58d8ea tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:50.984478 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b6bf042a-c915-4243-8a87-f552ec58d8ea tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:50.985268 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b6bf042a-c915-4243-8a87-f552ec58d8ea tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:50.985704 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b6bf042a-c915-4243-8a87-f552ec58d8ea tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:51.157844 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-9ff6f2f4-76aa-4ef9-9216-369fdcde0515 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:51.159125 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-9ff6f2f4-76aa-4ef9-9216-369fdcde0515 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:51.166269 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9ff6f2f4-76aa-4ef9-9216-369fdcde0515 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:51.166753 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9ff6f2f4-76aa-4ef9-9216-369fdcde0515 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:51.167535 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9ff6f2f4-76aa-4ef9-9216-369fdcde0515 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:51.167970 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9ff6f2f4-76aa-4ef9-9216-369fdcde0515 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:51.357049 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-9ff6f2f4-76aa-4ef9-9216-369fdcde0515 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:51.369767 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-9ff6f2f4-76aa-4ef9-9216-369fdcde0515 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:51.372533 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-9ff6f2f4-76aa-4ef9-9216-369fdcde0515 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:51.373758 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-9ff6f2f4-76aa-4ef9-9216-369fdcde0515 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.219899 Aug 03 12:14:51.374339 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 222/471] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:51 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:14:51.495341 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b6bf042a-c915-4243-8a87-f552ec58d8ea tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:51.503344 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b6bf042a-c915-4243-8a87-f552ec58d8ea tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1707 microversion: 2.1 time: 0.534110 Aug 03 12:14:51.503925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 250/472] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:50 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1707 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:52.397283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-97ed3b7c-5cbb-4f8d-92e4-dc56154fe726 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:52.397911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-97ed3b7c-5cbb-4f8d-92e4-dc56154fe726 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:52.405861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-97ed3b7c-5cbb-4f8d-92e4-dc56154fe726 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:52.406358 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-97ed3b7c-5cbb-4f8d-92e4-dc56154fe726 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:52.407196 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-97ed3b7c-5cbb-4f8d-92e4-dc56154fe726 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:52.407640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-97ed3b7c-5cbb-4f8d-92e4-dc56154fe726 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:52.525492 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-57fa4773-4e15-447e-b0a8-c625c1307c5c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:52.526207 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-57fa4773-4e15-447e-b0a8-c625c1307c5c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:52.533029 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-57fa4773-4e15-447e-b0a8-c625c1307c5c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:52.533485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-57fa4773-4e15-447e-b0a8-c625c1307c5c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:52.534245 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-57fa4773-4e15-447e-b0a8-c625c1307c5c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:52.534700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-57fa4773-4e15-447e-b0a8-c625c1307c5c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:52.548592 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-97ed3b7c-5cbb-4f8d-92e4-dc56154fe726 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:52.557163 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-97ed3b7c-5cbb-4f8d-92e4-dc56154fe726 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:52.558703 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-97ed3b7c-5cbb-4f8d-92e4-dc56154fe726 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:52.559937 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-97ed3b7c-5cbb-4f8d-92e4-dc56154fe726 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.167131 Aug 03 12:14:52.560587 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 223/473] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:52 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:52.667474 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-57fa4773-4e15-447e-b0a8-c625c1307c5c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:52.675445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-57fa4773-4e15-447e-b0a8-c625c1307c5c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1707 microversion: 2.1 time: 0.154392 Aug 03 12:14:52.676019 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 251/474] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:52 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1707 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:14:53.582769 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0e7fb1fe-52a6-440c-ac3e-7cc6edb9ad83 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:53.583359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-0e7fb1fe-52a6-440c-ac3e-7cc6edb9ad83 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:53.590712 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0e7fb1fe-52a6-440c-ac3e-7cc6edb9ad83 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:53.591156 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0e7fb1fe-52a6-440c-ac3e-7cc6edb9ad83 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:53.591921 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0e7fb1fe-52a6-440c-ac3e-7cc6edb9ad83 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:53.592351 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0e7fb1fe-52a6-440c-ac3e-7cc6edb9ad83 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:53.699743 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a63803e9-9274-4c10-9126-52c4e501f332 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:53.700549 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a63803e9-9274-4c10-9126-52c4e501f332 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:53.708443 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a63803e9-9274-4c10-9126-52c4e501f332 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:53.709219 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a63803e9-9274-4c10-9126-52c4e501f332 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:53.711160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a63803e9-9274-4c10-9126-52c4e501f332 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:53.715021 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a63803e9-9274-4c10-9126-52c4e501f332 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:53.737712 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-0e7fb1fe-52a6-440c-ac3e-7cc6edb9ad83 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:53.746730 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-0e7fb1fe-52a6-440c-ac3e-7cc6edb9ad83 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:53.748260 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-0e7fb1fe-52a6-440c-ac3e-7cc6edb9ad83 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:53.749464 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-0e7fb1fe-52a6-440c-ac3e-7cc6edb9ad83 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.170596 Aug 03 12:14:53.750593 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 224/475] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:53 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:14:53.864534 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a63803e9-9274-4c10-9126-52c4e501f332 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:53.874331 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a63803e9-9274-4c10-9126-52c4e501f332 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1711 microversion: 2.1 time: 0.180498 Aug 03 12:14:53.875218 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 252/476] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:14:53 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1711 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:14:54.783882 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-975b02a2-8171-4aaf-b992-9bd7f625ce68 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:54.784568 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-975b02a2-8171-4aaf-b992-9bd7f625ce68 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:54.792212 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-975b02a2-8171-4aaf-b992-9bd7f625ce68 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:54.792648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-975b02a2-8171-4aaf-b992-9bd7f625ce68 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:54.793444 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-975b02a2-8171-4aaf-b992-9bd7f625ce68 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:54.793877 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-975b02a2-8171-4aaf-b992-9bd7f625ce68 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:54.936793 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-975b02a2-8171-4aaf-b992-9bd7f625ce68 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:54.945486 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-975b02a2-8171-4aaf-b992-9bd7f625ce68 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:54.947020 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-975b02a2-8171-4aaf-b992-9bd7f625ce68 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:54.948189 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-975b02a2-8171-4aaf-b992-9bd7f625ce68 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.168426 Aug 03 12:14:54.948751 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 225/477] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:54 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:55.794520 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-8ad124c4-b5aa-46b7-8f39-45ee32c21b62 req-68896938-532b-458d-a885-5e1046469027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afb38cd-ec9c-4509-b7c8-91b170684ec5", "name": "network-vif-plugged", "status": "completed", "tag": "8f2969cf-b117-4fef-a2f6-5587992eefda"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:14:55.805698 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-8ad124c4-b5aa-46b7-8f39-45ee32c21b62 req-68896938-532b-458d-a885-5e1046469027 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:55.806138 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-8ad124c4-b5aa-46b7-8f39-45ee32c21b62 req-68896938-532b-458d-a885-5e1046469027 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:55.818692 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-8ad124c4-b5aa-46b7-8f39-45ee32c21b62 req-68896938-532b-458d-a885-5e1046469027 service nova] Creating event network-vif-plugged:8f2969cf-b117-4fef-a2f6-5587992eefda for instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 on hv-cinder-83602 Aug 03 12:14:55.823991 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-8ad124c4-b5aa-46b7-8f39-45ee32c21b62 req-68896938-532b-458d-a885-5e1046469027 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033272 Aug 03 12:14:55.824863 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 253/478] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:14:55.973307 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a1c01e6c-903f-4d42-b2b2-7c61d367b3fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:55.973920 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a1c01e6c-903f-4d42-b2b2-7c61d367b3fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:55.981329 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a1c01e6c-903f-4d42-b2b2-7c61d367b3fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:55.981767 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a1c01e6c-903f-4d42-b2b2-7c61d367b3fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:55.982570 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a1c01e6c-903f-4d42-b2b2-7c61d367b3fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:55.983011 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a1c01e6c-903f-4d42-b2b2-7c61d367b3fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:56.130113 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a1c01e6c-903f-4d42-b2b2-7c61d367b3fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:56.139086 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a1c01e6c-903f-4d42-b2b2-7c61d367b3fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:56.140601 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a1c01e6c-903f-4d42-b2b2-7c61d367b3fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:56.141786 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a1c01e6c-903f-4d42-b2b2-7c61d367b3fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.172506 Aug 03 12:14:56.142365 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 226/479] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:55 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:57.167204 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-41df61ac-5a9a-4012-b09b-062d4d770dc5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:57.167840 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-41df61ac-5a9a-4012-b09b-062d4d770dc5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:57.175334 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-41df61ac-5a9a-4012-b09b-062d4d770dc5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:57.175789 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-41df61ac-5a9a-4012-b09b-062d4d770dc5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:57.176561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-41df61ac-5a9a-4012-b09b-062d4d770dc5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:57.176991 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-41df61ac-5a9a-4012-b09b-062d4d770dc5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:57.314221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-41df61ac-5a9a-4012-b09b-062d4d770dc5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:57.323462 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-41df61ac-5a9a-4012-b09b-062d4d770dc5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:57.324966 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-41df61ac-5a9a-4012-b09b-062d4d770dc5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:57.326143 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-41df61ac-5a9a-4012-b09b-062d4d770dc5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.164524 Aug 03 12:14:57.326740 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 254/480] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:57 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:58.349764 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ba94dff3-8b7b-4b50-8300-78c570d2707f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:58.350375 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-ba94dff3-8b7b-4b50-8300-78c570d2707f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:58.357534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ba94dff3-8b7b-4b50-8300-78c570d2707f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:58.357985 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ba94dff3-8b7b-4b50-8300-78c570d2707f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:58.358788 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ba94dff3-8b7b-4b50-8300-78c570d2707f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:58.359230 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ba94dff3-8b7b-4b50-8300-78c570d2707f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:58.498717 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ba94dff3-8b7b-4b50-8300-78c570d2707f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:58.508181 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ba94dff3-8b7b-4b50-8300-78c570d2707f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:58.509674 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ba94dff3-8b7b-4b50-8300-78c570d2707f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:58.510877 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ba94dff3-8b7b-4b50-8300-78c570d2707f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.165065 Aug 03 12:14:58.511442 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 227/481] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:58 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:14:59.535197 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b8808664-3946-481c-a824-f51f5cc49f6d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:14:59.535811 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b8808664-3946-481c-a824-f51f5cc49f6d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:14:59.543498 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b8808664-3946-481c-a824-f51f5cc49f6d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:59.543952 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b8808664-3946-481c-a824-f51f5cc49f6d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:59.544737 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b8808664-3946-481c-a824-f51f5cc49f6d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:14:59.545178 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b8808664-3946-481c-a824-f51f5cc49f6d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:14:59.688072 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b8808664-3946-481c-a824-f51f5cc49f6d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:59.697146 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b8808664-3946-481c-a824-f51f5cc49f6d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:59.698923 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b8808664-3946-481c-a824-f51f5cc49f6d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:14:59.699882 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b8808664-3946-481c-a824-f51f5cc49f6d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1808 microversion: 2.20 time: 0.168616 Aug 03 12:14:59.700449 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 255/482] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:14:59 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:15:00.725614 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0d79388c-d44d-420f-9216-acf8aa89ffb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:00.726842 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-0d79388c-d44d-420f-9216-acf8aa89ffb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:00.738095 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0d79388c-d44d-420f-9216-acf8aa89ffb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:00.738841 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0d79388c-d44d-420f-9216-acf8aa89ffb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:00.740235 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0d79388c-d44d-420f-9216-acf8aa89ffb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:00.741520 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0d79388c-d44d-420f-9216-acf8aa89ffb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:00.748646 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=100 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:00.902408 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-0d79388c-d44d-420f-9216-acf8aa89ffb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:00.911680 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-0d79388c-d44d-420f-9216-acf8aa89ffb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:00.913204 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-0d79388c-d44d-420f-9216-acf8aa89ffb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:00.914390 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-0d79388c-d44d-420f-9216-acf8aa89ffb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1795 microversion: 2.20 time: 0.195711 Aug 03 12:15:00.914998 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 228/483] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:15:00 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1795 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:15:05.816633 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-06c7d178-57ca-433c-bb5c-683946357e66 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:05.817480 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-06c7d178-57ca-433c-bb5c-683946357e66 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:05.826356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06c7d178-57ca-433c-bb5c-683946357e66 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:05.826843 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06c7d178-57ca-433c-bb5c-683946357e66 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:05.827615 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06c7d178-57ca-433c-bb5c-683946357e66 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:05.828047 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-06c7d178-57ca-433c-bb5c-683946357e66 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:05.853906 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-06c7d178-57ca-433c-bb5c-683946357e66 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf/ips" status: 200 len: 150 microversion: 2.1 time: 0.043190 Aug 03 12:15:05.854550 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 256/484] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 3 12:15:05 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:15:05.871949 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2f87f40e-9058-4c25-8915-4ab6de991783 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "660e1707-36bd-47f8-98de-1a96555b9ee5"}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:05.874402 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2f87f40e-9058-4c25-8915-4ab6de991783 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:05.881597 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2f87f40e-9058-4c25-8915-4ab6de991783 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:05.882732 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2f87f40e-9058-4c25-8915-4ab6de991783 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:05.883687 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2f87f40e-9058-4c25-8915-4ab6de991783 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:05.884428 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2f87f40e-9058-4c25-8915-4ab6de991783 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:05.973482 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-2f87f40e-9058-4c25-8915-4ab6de991783 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Invalid volume: volume 660e1707-36bd-47f8-98de-1a96555b9ee5 is already attached to instances: fedea0ca-7f85-49dc-8459-160418843f05 Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2f87f40e-9058-4c25-8915-4ab6de991783 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: POST /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf/os-volume_attachments HTTP/1.1 Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 74 Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:15:05.975349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:15:05.976911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:15:05.976911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:15:05.976911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:15:05.976911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:15:05.976911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:15:05.976911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:15:05.976911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:15:05.976911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:15:05.976911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:15:05.976911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Aug 03 12:15:05.976911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {"volumeAttachment": {"volumeId": "660e1707-36bd-47f8-98de-1a96555b9ee5"}} Aug 03 12:15:05.976911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Invalid volume: volume 660e1707-36bd-47f8-98de-1a96555b9ee5 is already attached to instances: fedea0ca-7f85-49dc-8459-160418843f05 Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'server_id': '2776d6e3-3b32-4548-828f-cc640cc445bf', 'body': {'volumeAttachment': {'volumeId': '660e1707-36bd-47f8-98de-1a96555b9ee5'}}} Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 660e1707-36bd-47f8-98de-1a96555b9ee5 is already attached to instances: fedea0ca-7f85-49dc-8459-160418843f05 Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:05.977808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 660e1707-36bd-47f8-98de-1a96555b9ee5 is already attached to instances: fedea0ca-7f85-49dc-8459-160418843f05 Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:05.979050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:15:05.980265 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:15:05.980265 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:15:05.980265 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:15:05.980265 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 660e1707-36bd-47f8-98de-1a96555b9ee5 is already attached to instances: fedea0ca-7f85-49dc-8459-160418843f05 Aug 03 12:15:05.980265 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:05.980265 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2f87f40e-9058-4c25-8915-4ab6de991783 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 400 to user: Invalid volume: volume 660e1707-36bd-47f8-98de-1a96555b9ee5 is already attached to instances: fedea0ca-7f85-49dc-8459-160418843f05 {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:15:05.980265 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2f87f40e-9058-4c25-8915-4ab6de991783 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "POST /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109599 Aug 03 12:15:05.980265 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 229/485] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:15:05 2022] POST /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 12:15:05.985907 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-523da54e-2df7-4df5-8d49-9295b309c885 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:05.986404 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-523da54e-2df7-4df5-8d49-9295b309c885 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:05.993033 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-523da54e-2df7-4df5-8d49-9295b309c885 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:05.993477 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-523da54e-2df7-4df5-8d49-9295b309c885 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:05.994246 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-523da54e-2df7-4df5-8d49-9295b309c885 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:05.994759 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-523da54e-2df7-4df5-8d49-9295b309c885 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:06.020564 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-523da54e-2df7-4df5-8d49-9295b309c885 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:15:06.100523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-523da54e-2df7-4df5-8d49-9295b309c885 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 204 len: 0 microversion: 2.1 time: 0.117974 Aug 03 12:15:06.101026 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 257/486] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:15:05 2022] DELETE /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:15:06.109424 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5e6a70f2-0e70-4cbc-afa8-3c803231e1c8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:06.110001 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5e6a70f2-0e70-4cbc-afa8-3c803231e1c8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:06.122349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e6a70f2-0e70-4cbc-afa8-3c803231e1c8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:06.122856 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e6a70f2-0e70-4cbc-afa8-3c803231e1c8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:06.124127 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e6a70f2-0e70-4cbc-afa8-3c803231e1c8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:06.124840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e6a70f2-0e70-4cbc-afa8-3c803231e1c8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:06.270343 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5e6a70f2-0e70-4cbc-afa8-3c803231e1c8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:06.278017 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5e6a70f2-0e70-4cbc-afa8-3c803231e1c8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1682 microversion: 2.1 time: 0.172523 Aug 03 12:15:06.278615 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 230/487] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:06 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:07.300826 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9c6bf8ef-3899-4708-80fd-35c78ad99292 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:07.301539 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9c6bf8ef-3899-4708-80fd-35c78ad99292 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:07.303973 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:07.310346 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9c6bf8ef-3899-4708-80fd-35c78ad99292 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:07.310823 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9c6bf8ef-3899-4708-80fd-35c78ad99292 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:07.311602 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9c6bf8ef-3899-4708-80fd-35c78ad99292 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:07.312038 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9c6bf8ef-3899-4708-80fd-35c78ad99292 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:07.446107 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9c6bf8ef-3899-4708-80fd-35c78ad99292 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:07.454288 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9c6bf8ef-3899-4708-80fd-35c78ad99292 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1682 microversion: 2.1 time: 0.157875 Aug 03 12:15:07.454882 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 258/488] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:07 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:08.479226 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-28984bca-f453-4245-8388-122037585751 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:08.479885 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-28984bca-f453-4245-8388-122037585751 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:08.487065 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-28984bca-f453-4245-8388-122037585751 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:08.487520 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-28984bca-f453-4245-8388-122037585751 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:08.488310 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-28984bca-f453-4245-8388-122037585751 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:08.488751 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-28984bca-f453-4245-8388-122037585751 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:08.627555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-28984bca-f453-4245-8388-122037585751 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:08.637040 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-28984bca-f453-4245-8388-122037585751 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 200 len: 1682 microversion: 2.1 time: 0.162815 Aug 03 12:15:08.637639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 231/489] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:08 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:08.970018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-cbef5739-a430-4f9f-a6aa-ad463eff5e9e req-3c676045-a059-41d1-a4c5-84a5c47e4741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2776d6e3-3b32-4548-828f-cc640cc445bf", "name": "network-vif-deleted", "tag": "d073cee3-622e-495d-87b3-79a9d0c5308a"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:08.988758 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-cbef5739-a430-4f9f-a6aa-ad463eff5e9e req-3c676045-a059-41d1-a4c5-84a5c47e4741 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:08.989189 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-cbef5739-a430-4f9f-a6aa-ad463eff5e9e req-3c676045-a059-41d1-a4c5-84a5c47e4741 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:09.005427 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-cbef5739-a430-4f9f-a6aa-ad463eff5e9e req-3c676045-a059-41d1-a4c5-84a5c47e4741 service nova] Creating event network-vif-deleted:d073cee3-622e-495d-87b3-79a9d0c5308a for instance 2776d6e3-3b32-4548-828f-cc640cc445bf on hv-cinder-83602 Aug 03 12:15:09.011422 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-cbef5739-a430-4f9f-a6aa-ad463eff5e9e req-3c676045-a059-41d1-a4c5-84a5c47e4741 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045987 Aug 03 12:15:09.012271 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 259/490] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:15:09.660562 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e5dc78db-08a2-4211-835f-03d991a56b17 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:09.661996 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e5dc78db-08a2-4211-835f-03d991a56b17 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:09.666763 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=46 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:09.671944 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e5dc78db-08a2-4211-835f-03d991a56b17 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:09.672512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e5dc78db-08a2-4211-835f-03d991a56b17 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:09.673389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e5dc78db-08a2-4211-835f-03d991a56b17 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:09.674135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e5dc78db-08a2-4211-835f-03d991a56b17 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:09.690140 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-e5dc78db-08a2-4211-835f-03d991a56b17 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e5dc78db-08a2-4211-835f-03d991a56b17 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf HTTP/1.1 Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:15:09.692016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:15:09.693640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:15:09.693640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:15:09.693640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:15:09.693640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:15:09.693640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:15:09.693640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:15:09.693640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:15:09.693640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:15:09.693640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:15:09.693640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:15:09.693640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:15:09.693640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': '2776d6e3-3b32-4548-828f-cc640cc445bf'} Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:15:09.695441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:15:09.697512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:09.700030 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e5dc78db-08a2-4211-835f-03d991a56b17 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 404 to user: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:15:09.700030 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e5dc78db-08a2-4211-835f-03d991a56b17 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 404 len: 111 microversion: 2.1 time: 0.038603 Aug 03 12:15:09.700030 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 232/491] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:09 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:15:09.704562 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6a7784e0-1bc7-456b-9025-2be56a1b9b6b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '.version_select at 0x7f14dc071ca0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:09.727582 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6a7784e0-1bc7-456b-9025-2be56a1b9b6b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515227677" status: 202 len: 0 microversion: 2.1 time: 0.028664 Aug 03 12:15:09.728160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 260/492] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 3 12:15:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515227677 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:15:10.543767 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d2bcc213-7e33-48d0-aac9-63d397e5358d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:10.544252 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d2bcc213-7e33-48d0-aac9-63d397e5358d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:10.550467 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d2bcc213-7e33-48d0-aac9-63d397e5358d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:10.550915 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d2bcc213-7e33-48d0-aac9-63d397e5358d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:10.551684 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d2bcc213-7e33-48d0-aac9-63d397e5358d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:10.552116 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d2bcc213-7e33-48d0-aac9-63d397e5358d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:10.700997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-d2bcc213-7e33-48d0-aac9-63d397e5358d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lazy-loading 'services' on Instance uuid fedea0ca-7f85-49dc-8459-160418843f05 {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:15:10.829114 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d2bcc213-7e33-48d0-aac9-63d397e5358d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05/os-volume_attachments/660e1707-36bd-47f8-98de-1a96555b9ee5" status: 202 len: 0 microversion: 2.1 time: 0.288996 Aug 03 12:15:10.829724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 233/493] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 3 12:15:10 2022] DELETE /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05/os-volume_attachments/660e1707-36bd-47f8-98de-1a96555b9ee5 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:15:10.845495 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-25e8f28a-b379-4fbb-aa98-908d3d7ca4f7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:10.848116 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-25e8f28a-b379-4fbb-aa98-908d3d7ca4f7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:10.858010 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-25e8f28a-b379-4fbb-aa98-908d3d7ca4f7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:10.858499 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-25e8f28a-b379-4fbb-aa98-908d3d7ca4f7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:10.859299 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-25e8f28a-b379-4fbb-aa98-908d3d7ca4f7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:10.859737 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-25e8f28a-b379-4fbb-aa98-908d3d7ca4f7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:10.896389 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-25e8f28a-b379-4fbb-aa98-908d3d7ca4f7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061464 Aug 03 12:15:10.901228 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 261/494] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:15:10 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:15:11.910280 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cd7498c5-5951-47e0-afef-c08bdb71bdc1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:11.912958 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-cd7498c5-5951-47e0-afef-c08bdb71bdc1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:11.920396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd7498c5-5951-47e0-afef-c08bdb71bdc1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:11.920839 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd7498c5-5951-47e0-afef-c08bdb71bdc1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:11.921617 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd7498c5-5951-47e0-afef-c08bdb71bdc1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:11.922051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cd7498c5-5951-47e0-afef-c08bdb71bdc1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:11.955253 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-cd7498c5-5951-47e0-afef-c08bdb71bdc1 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049166 Aug 03 12:15:11.955746 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 234/495] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:15:11 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 12:15:12.020178 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e697109d-d951-4487-a09b-3fa9f5e99ec0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:12.020797 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e697109d-d951-4487-a09b-3fa9f5e99ec0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:12.027681 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e697109d-d951-4487-a09b-3fa9f5e99ec0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:12.028144 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e697109d-d951-4487-a09b-3fa9f5e99ec0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:12.028959 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e697109d-d951-4487-a09b-3fa9f5e99ec0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:12.029402 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e697109d-d951-4487-a09b-3fa9f5e99ec0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:12.055426 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e697109d-d951-4487-a09b-3fa9f5e99ec0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:15:12.153296 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e697109d-d951-4487-a09b-3fa9f5e99ec0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 204 len: 0 microversion: 2.1 time: 0.136922 Aug 03 12:15:12.158387 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 262/496] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:15:12 2022] DELETE /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:15:12.175858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d0899549-0f0a-436a-b127-20eacc67fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:12.176475 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d0899549-0f0a-436a-b127-20eacc67fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:12.183153 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d0899549-0f0a-436a-b127-20eacc67fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:12.183607 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d0899549-0f0a-436a-b127-20eacc67fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:12.184358 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d0899549-0f0a-436a-b127-20eacc67fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:12.184794 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d0899549-0f0a-436a-b127-20eacc67fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:12.327417 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d0899549-0f0a-436a-b127-20eacc67fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:12.336153 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d0899549-0f0a-436a-b127-20eacc67fa60 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1683 microversion: 2.1 time: 0.172560 Aug 03 12:15:12.336904 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 235/497] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:12 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:13.358717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-61481145-aea8-47ea-97bb-ba938cc00b1d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:13.359424 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-61481145-aea8-47ea-97bb-ba938cc00b1d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:13.365983 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61481145-aea8-47ea-97bb-ba938cc00b1d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:13.366446 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61481145-aea8-47ea-97bb-ba938cc00b1d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:13.367819 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61481145-aea8-47ea-97bb-ba938cc00b1d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:13.368259 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61481145-aea8-47ea-97bb-ba938cc00b1d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:13.411503 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-db3de5f1-bef0-4aee-ae57-14f94b852e99 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c97255cd-621a-49f8-b1e9-ac08182dbd96"}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:13.414527 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-db3de5f1-bef0-4aee-ae57-14f94b852e99 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:13.421287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-db3de5f1-bef0-4aee-ae57-14f94b852e99 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:13.421729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-db3de5f1-bef0-4aee-ae57-14f94b852e99 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:13.422525 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-db3de5f1-bef0-4aee-ae57-14f94b852e99 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:13.422963 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-db3de5f1-bef0-4aee-ae57-14f94b852e99 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:13.505438 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-61481145-aea8-47ea-97bb-ba938cc00b1d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:13.515279 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-61481145-aea8-47ea-97bb-ba938cc00b1d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1683 microversion: 2.1 time: 0.160748 Aug 03 12:15:13.515855 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 263/498] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:13 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:13.773882 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-db3de5f1-bef0-4aee-ae57-14f94b852e99 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "POST /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366061 Aug 03 12:15:13.774725 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 236/499] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:15:13 2022] POST /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:15:14.537925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-61664ffd-c673-43cf-bfe7-6f08bd07990e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:14.538935 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-61664ffd-c673-43cf-bfe7-6f08bd07990e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:14.545946 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61664ffd-c673-43cf-bfe7-6f08bd07990e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:14.546566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61664ffd-c673-43cf-bfe7-6f08bd07990e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:14.547298 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61664ffd-c673-43cf-bfe7-6f08bd07990e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:14.547904 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61664ffd-c673-43cf-bfe7-6f08bd07990e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:15.028212 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-61664ffd-c673-43cf-bfe7-6f08bd07990e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:15.036027 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-61664ffd-c673-43cf-bfe7-6f08bd07990e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 200 len: 1683 microversion: 2.1 time: 0.502378 Aug 03 12:15:15.036608 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 264/500] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:14 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 1683 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:15.420701 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-cafe98d3-e4e6-4bc0-8636-99bb3d7ff1cd req-20bb6fb0-a7eb-4494-a93e-1e5b9ea48bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fedea0ca-7f85-49dc-8459-160418843f05", "name": "network-vif-deleted", "tag": "1d3fd848-19fd-4089-a319-b9a584a9c430"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:15.431418 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-cafe98d3-e4e6-4bc0-8636-99bb3d7ff1cd req-20bb6fb0-a7eb-4494-a93e-1e5b9ea48bd7 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:15.431862 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-cafe98d3-e4e6-4bc0-8636-99bb3d7ff1cd req-20bb6fb0-a7eb-4494-a93e-1e5b9ea48bd7 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:15.445152 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-cafe98d3-e4e6-4bc0-8636-99bb3d7ff1cd req-20bb6fb0-a7eb-4494-a93e-1e5b9ea48bd7 service nova] Creating event network-vif-deleted:1d3fd848-19fd-4089-a319-b9a584a9c430 for instance fedea0ca-7f85-49dc-8459-160418843f05 on hv-cinder-83602 Aug 03 12:15:15.450495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-cafe98d3-e4e6-4bc0-8636-99bb3d7ff1cd req-20bb6fb0-a7eb-4494-a93e-1e5b9ea48bd7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034168 Aug 03 12:15:15.451895 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 237/501] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:15:16.057756 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b61c78f9-1b37-48ae-ac18-83988ca700ea tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:16.058680 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b61c78f9-1b37-48ae-ac18-83988ca700ea tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:16.065548 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b61c78f9-1b37-48ae-ac18-83988ca700ea tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:16.065999 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b61c78f9-1b37-48ae-ac18-83988ca700ea tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:16.066830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b61c78f9-1b37-48ae-ac18-83988ca700ea tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:16.067270 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b61c78f9-1b37-48ae-ac18-83988ca700ea tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:16.082410 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-b61c78f9-1b37-48ae-ac18-83988ca700ea tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b61c78f9-1b37-48ae-ac18-83988ca700ea tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 HTTP/1.1 Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:15:16.084110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:15:16.086363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:15:16.086363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:15:16.086363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:15:16.086363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:15:16.086363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:15:16.086363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:15:16.086363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:15:16.086363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:15:16.086363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:15:16.086363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:15:16.086363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:15:16.086363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'fedea0ca-7f85-49dc-8459-160418843f05'} Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:15:16.087292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:15:16.088833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:15:16.090346 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b61c78f9-1b37-48ae-ac18-83988ca700ea tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 404 to user: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:15:16.090346 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b61c78f9-1b37-48ae-ac18-83988ca700ea tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 404 len: 111 microversion: 2.1 time: 0.032149 Aug 03 12:15:16.090611 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 265/502] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:16 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:15:16.096858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-aecf3803-52f8-4b82-9682-8b8b5860534b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '.version_select at 0x7f14dc0fcb80>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:16.120216 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-aecf3803-52f8-4b82-9682-8b8b5860534b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748066561" status: 202 len: 0 microversion: 2.1 time: 0.028034 Aug 03 12:15:16.120809 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 238/503] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 3 12:15:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748066561 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:15:16.847818 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-33a07e9a-f05d-4c5c-bfd7-1e9b1ac8dc71 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Action: 'create', calling method: .version_select at 0x7f14dc0334c0>, body: {"keypair": {"name": "tempest-keypair-1495821952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+cN2lTo1hJAG2BU7JVsXZFrsgnaFccFl9f9avxYtt8CfoK/tvGuS1Sdpx1w0RPw6nz6IOnb6yKRw1/sfa2xG5/q4CDhM4vlZB2P2GDU1y2wr8qdTgb776CdmSw4vMbQg=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:16.864092 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-33a07e9a-f05d-4c5c-bfd7-1e9b1ac8dc71 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:15:16.868412 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-33a07e9a-f05d-4c5c-bfd7-1e9b1ac8dc71 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for user e7566583228946488bd1ab647bbe8059 and project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:15:16.891909 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-33a07e9a-f05d-4c5c-bfd7-1e9b1ac8dc71 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047965 Aug 03 12:15:16.892523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 266/504] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 3 12:15:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:15:18.306558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1632031044", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a64e775-73b7-4e56-9c06-9163d23fd664"}], "security_groups": [{"name": "tempest-securitygroup--377247643"}], "key_name": "tempest-keypair-1495821952", "user_data": "}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:18.424580 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.network.neutron [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] validate_networks() for [('5a64e775-73b7-4e56-9c06-9163d23fd664', None, None, None, None, None)] {{(pid=117911) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:15:18.801131 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Flavor limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:15:18.801553 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Image limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:15:18.802077 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Flavor pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:15:18.802415 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Image pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:15:18.802877 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:15:18.820633 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:18.821079 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:18.821941 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:18.822503 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:18.839969 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:15:18.844162 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for user e7566583228946488bd1ab647bbe8059 and project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:15:18.855509 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Going to run 1 instances... {{(pid=117911) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:15:18.857887 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:15:18.907879 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-9fe21edc-421e-45e5-a407-770e71b604a2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.606280 Aug 03 12:15:18.908532 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 239/505] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:15:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:15:18.920359 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-18cb75c5-282e-41db-8fda-9fcb635db28f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:18.920961 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-18cb75c5-282e-41db-8fda-9fcb635db28f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:18.988635 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-18cb75c5-282e-41db-8fda-9fcb635db28f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:18.996422 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-18cb75c5-282e-41db-8fda-9fcb635db28f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1242 microversion: 2.1 time: 0.080675 Aug 03 12:15:18.997148 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 267/506] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:18 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:20.017309 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b8faa421-ac33-487d-afaa-d0b7ec329920 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:20.017944 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b8faa421-ac33-487d-afaa-d0b7ec329920 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:20.025612 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b8faa421-ac33-487d-afaa-d0b7ec329920 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:20.026065 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b8faa421-ac33-487d-afaa-d0b7ec329920 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:20.026886 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b8faa421-ac33-487d-afaa-d0b7ec329920 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:20.027327 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b8faa421-ac33-487d-afaa-d0b7ec329920 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:20.098292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b8faa421-ac33-487d-afaa-d0b7ec329920 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:20.107309 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b8faa421-ac33-487d-afaa-d0b7ec329920 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1294 microversion: 2.1 time: 0.094256 Aug 03 12:15:20.107907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 240/507] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:20 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:21.128418 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b7c59b91-1104-4558-9d37-93cf2a9c97bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:21.128967 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b7c59b91-1104-4558-9d37-93cf2a9c97bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:21.136273 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7c59b91-1104-4558-9d37-93cf2a9c97bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:21.136803 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7c59b91-1104-4558-9d37-93cf2a9c97bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:21.137611 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7c59b91-1104-4558-9d37-93cf2a9c97bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:21.138049 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b7c59b91-1104-4558-9d37-93cf2a9c97bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:21.140988 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:21.217300 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b7c59b91-1104-4558-9d37-93cf2a9c97bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:21.227632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b7c59b91-1104-4558-9d37-93cf2a9c97bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1300 microversion: 2.1 time: 0.103073 Aug 03 12:15:21.228269 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 268/508] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:21 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:21.388645 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-49ae9978-86b0-48aa-8467-3cbdc707f010 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:21.391287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-49ae9978-86b0-48aa-8467-3cbdc707f010 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:21.399176 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-49ae9978-86b0-48aa-8467-3cbdc707f010 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:21.399636 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-49ae9978-86b0-48aa-8467-3cbdc707f010 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:21.400417 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-49ae9978-86b0-48aa-8467-3cbdc707f010 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:21.400858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-49ae9978-86b0-48aa-8467-3cbdc707f010 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:21.424518 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-49ae9978-86b0-48aa-8467-3cbdc707f010 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lazy-loading 'flavor' on Instance uuid 2b98bd00-4a41-43d7-a5c6-ff4644582d13 {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:15:21.568432 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-49ae9978-86b0-48aa-8467-3cbdc707f010 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "POST /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/action" status: 200 len: 32 microversion: 2.1 time: 0.183770 Aug 03 12:15:21.569626 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 241/509] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:15:21 2022] POST /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 12:15:21.584522 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-77afa12c-8369-477f-aa5b-092d599e96c3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:21.585720 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-77afa12c-8369-477f-aa5b-092d599e96c3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:21.597169 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-77afa12c-8369-477f-aa5b-092d599e96c3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:21.597767 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-77afa12c-8369-477f-aa5b-092d599e96c3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:21.598869 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-77afa12c-8369-477f-aa5b-092d599e96c3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:21.599509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-77afa12c-8369-477f-aa5b-092d599e96c3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:21.880536 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-77afa12c-8369-477f-aa5b-092d599e96c3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:21.891463 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-77afa12c-8369-477f-aa5b-092d599e96c3 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.313209 Aug 03 12:15:21.906672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 269/510] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:21 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:22.253554 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-87116d83-b237-4188-84cd-c35710ee4a06 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:22.254220 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-87116d83-b237-4188-84cd-c35710ee4a06 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:22.261868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87116d83-b237-4188-84cd-c35710ee4a06 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:22.262302 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87116d83-b237-4188-84cd-c35710ee4a06 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:22.263138 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87116d83-b237-4188-84cd-c35710ee4a06 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:22.263569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87116d83-b237-4188-84cd-c35710ee4a06 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:22.422024 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7fe5e74d-ad34-4726-9a43-62b0410e5084 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:22.426875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7fe5e74d-ad34-4726-9a43-62b0410e5084 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:22.439487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7fe5e74d-ad34-4726-9a43-62b0410e5084 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:22.441760 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7fe5e74d-ad34-4726-9a43-62b0410e5084 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:22.442601 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7fe5e74d-ad34-4726-9a43-62b0410e5084 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:22.443481 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7fe5e74d-ad34-4726-9a43-62b0410e5084 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:22.471721 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-87116d83-b237-4188-84cd-c35710ee4a06 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:22.481333 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-87116d83-b237-4188-84cd-c35710ee4a06 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1367 microversion: 2.1 time: 0.232366 Aug 03 12:15:22.495767 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 242/511] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:22 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:22.501830 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-13075f4d-c3c2-4de9-8886-e1ee634605ca req-09888ab9-85b4-4f2d-8e34-69c25303dc22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a", "tag": "f10aded2-66f3-4213-be84-e7efad0f47ed"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:22.512912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-13075f4d-c3c2-4de9-8886-e1ee634605ca req-09888ab9-85b4-4f2d-8e34-69c25303dc22 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:22.513618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-13075f4d-c3c2-4de9-8886-e1ee634605ca req-09888ab9-85b4-4f2d-8e34-69c25303dc22 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:22.526227 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-13075f4d-c3c2-4de9-8886-e1ee634605ca req-09888ab9-85b4-4f2d-8e34-69c25303dc22 service nova] Creating event network-changed:f10aded2-66f3-4213-be84-e7efad0f47ed for instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a on hv-cinder-83602 Aug 03 12:15:22.531600 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-13075f4d-c3c2-4de9-8886-e1ee634605ca req-09888ab9-85b4-4f2d-8e34-69c25303dc22 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034194 Aug 03 12:15:22.532305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 243/512] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:15:22.567082 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7fe5e74d-ad34-4726-9a43-62b0410e5084 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "POST /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/action" status: 202 len: 0 microversion: 2.1 time: 0.152868 Aug 03 12:15:22.568127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 270/513] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:15:22 2022] POST /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:15:22.577621 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-20938c3a-59b2-4172-8d5e-345c8a0794f5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:22.578332 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-20938c3a-59b2-4172-8d5e-345c8a0794f5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:22.585931 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-20938c3a-59b2-4172-8d5e-345c8a0794f5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:22.586402 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-20938c3a-59b2-4172-8d5e-345c8a0794f5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:22.587917 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-20938c3a-59b2-4172-8d5e-345c8a0794f5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:22.588583 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-20938c3a-59b2-4172-8d5e-345c8a0794f5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:22.612598 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:22.857259 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-20938c3a-59b2-4172-8d5e-345c8a0794f5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:22.870090 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-20938c3a-59b2-4172-8d5e-345c8a0794f5 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1750 microversion: 2.1 time: 0.296626 Aug 03 12:15:22.881257 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 244/514] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:22 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1750 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:22.921070 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8b814a5c-02d7-4810-9f22-631f110f7cac tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:22.923020 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8b814a5c-02d7-4810-9f22-631f110f7cac tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:22.935581 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8b814a5c-02d7-4810-9f22-631f110f7cac tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:22.936580 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8b814a5c-02d7-4810-9f22-631f110f7cac tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:22.938147 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8b814a5c-02d7-4810-9f22-631f110f7cac tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:22.939135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8b814a5c-02d7-4810-9f22-631f110f7cac tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:23.170079 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8b814a5c-02d7-4810-9f22-631f110f7cac tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:23.177239 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8b814a5c-02d7-4810-9f22-631f110f7cac tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.264677 Aug 03 12:15:23.178197 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 271/515] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:22 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:23.502786 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e8f3e09c-cab5-4c2c-b965-d2112e295399 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:23.503400 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e8f3e09c-cab5-4c2c-b965-d2112e295399 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:23.515346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e8f3e09c-cab5-4c2c-b965-d2112e295399 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:23.516078 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e8f3e09c-cab5-4c2c-b965-d2112e295399 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:23.516920 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e8f3e09c-cab5-4c2c-b965-d2112e295399 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:23.517353 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e8f3e09c-cab5-4c2c-b965-d2112e295399 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:23.657178 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e8f3e09c-cab5-4c2c-b965-d2112e295399 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:23.665206 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e8f3e09c-cab5-4c2c-b965-d2112e295399 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1367 microversion: 2.1 time: 0.166390 Aug 03 12:15:23.666069 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 245/516] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:23 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:23.892368 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-36105390-3063-45ab-a0c8-cc7b2008b7a9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:23.892986 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-36105390-3063-45ab-a0c8-cc7b2008b7a9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:23.899834 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-36105390-3063-45ab-a0c8-cc7b2008b7a9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:23.900285 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-36105390-3063-45ab-a0c8-cc7b2008b7a9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:23.901057 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-36105390-3063-45ab-a0c8-cc7b2008b7a9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:23.901505 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-36105390-3063-45ab-a0c8-cc7b2008b7a9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:24.056376 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-36105390-3063-45ab-a0c8-cc7b2008b7a9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:24.065252 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-36105390-3063-45ab-a0c8-cc7b2008b7a9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1750 microversion: 2.1 time: 0.176665 Aug 03 12:15:24.065955 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 272/517] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:23 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:24.200131 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-44a95efe-ac1f-4393-89b1-3c855282d8a5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:24.200736 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-44a95efe-ac1f-4393-89b1-3c855282d8a5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:24.206994 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-44a95efe-ac1f-4393-89b1-3c855282d8a5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:24.207471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-44a95efe-ac1f-4393-89b1-3c855282d8a5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:24.208248 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-44a95efe-ac1f-4393-89b1-3c855282d8a5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:24.208685 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-44a95efe-ac1f-4393-89b1-3c855282d8a5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:24.399371 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-44a95efe-ac1f-4393-89b1-3c855282d8a5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:24.408466 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-44a95efe-ac1f-4393-89b1-3c855282d8a5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.212136 Aug 03 12:15:24.409067 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 246/518] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:24 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:24.687450 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a7e0c5c0-b57b-4ecb-a139-65ec75717a80 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:24.688155 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a7e0c5c0-b57b-4ecb-a139-65ec75717a80 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:24.694890 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a7e0c5c0-b57b-4ecb-a139-65ec75717a80 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:24.695347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a7e0c5c0-b57b-4ecb-a139-65ec75717a80 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:24.696136 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a7e0c5c0-b57b-4ecb-a139-65ec75717a80 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:24.696660 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a7e0c5c0-b57b-4ecb-a139-65ec75717a80 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:24.872954 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a7e0c5c0-b57b-4ecb-a139-65ec75717a80 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:24.881230 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a7e0c5c0-b57b-4ecb-a139-65ec75717a80 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1367 microversion: 2.1 time: 0.198215 Aug 03 12:15:24.881819 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 273/519] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:24 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:25.088417 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5e253e3a-1032-48ee-a0a6-780afecb00be tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:25.089054 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5e253e3a-1032-48ee-a0a6-780afecb00be tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:25.095583 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e253e3a-1032-48ee-a0a6-780afecb00be tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:25.096034 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e253e3a-1032-48ee-a0a6-780afecb00be tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:25.096804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e253e3a-1032-48ee-a0a6-780afecb00be tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:25.097243 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e253e3a-1032-48ee-a0a6-780afecb00be tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:25.247883 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5e253e3a-1032-48ee-a0a6-780afecb00be tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:25.255960 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5e253e3a-1032-48ee-a0a6-780afecb00be tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.172227 Aug 03 12:15:25.256539 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 247/520] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:25 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:25.432553 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8aa2a765-e00d-42c5-a331-16c66cea81ef tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:25.433100 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8aa2a765-e00d-42c5-a331-16c66cea81ef tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:25.439476 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8aa2a765-e00d-42c5-a331-16c66cea81ef tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:25.439915 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8aa2a765-e00d-42c5-a331-16c66cea81ef tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:25.440662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8aa2a765-e00d-42c5-a331-16c66cea81ef tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:25.441092 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8aa2a765-e00d-42c5-a331-16c66cea81ef tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:25.571321 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8aa2a765-e00d-42c5-a331-16c66cea81ef tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:25.579565 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8aa2a765-e00d-42c5-a331-16c66cea81ef tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.150899 Aug 03 12:15:25.580169 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 274/521] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:25 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:25.905280 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-8eb37b38-54f2-4aae-803a-cdf69a544f3b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:25.905939 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-8eb37b38-54f2-4aae-803a-cdf69a544f3b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:25.913195 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8eb37b38-54f2-4aae-803a-cdf69a544f3b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:25.913655 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8eb37b38-54f2-4aae-803a-cdf69a544f3b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:25.914476 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8eb37b38-54f2-4aae-803a-cdf69a544f3b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:25.914934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8eb37b38-54f2-4aae-803a-cdf69a544f3b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:26.065033 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-8eb37b38-54f2-4aae-803a-cdf69a544f3b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:26.077803 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-8eb37b38-54f2-4aae-803a-cdf69a544f3b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1367 microversion: 2.1 time: 0.176530 Aug 03 12:15:26.078593 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 248/522] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:25 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:26.279089 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2c5c786e-1590-4d1a-acfe-d95dde936deb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:26.279622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2c5c786e-1590-4d1a-acfe-d95dde936deb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:26.285829 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c5c786e-1590-4d1a-acfe-d95dde936deb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:26.286287 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c5c786e-1590-4d1a-acfe-d95dde936deb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:26.287085 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c5c786e-1590-4d1a-acfe-d95dde936deb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:26.287524 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2c5c786e-1590-4d1a-acfe-d95dde936deb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:26.438138 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2c5c786e-1590-4d1a-acfe-d95dde936deb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:26.447254 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2c5c786e-1590-4d1a-acfe-d95dde936deb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.172084 Aug 03 12:15:26.447850 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 275/523] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:26 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:26.604527 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2562c8a1-e121-4004-a2d4-2ce371b6c402 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:26.605072 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2562c8a1-e121-4004-a2d4-2ce371b6c402 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:26.612708 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2562c8a1-e121-4004-a2d4-2ce371b6c402 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:26.613235 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2562c8a1-e121-4004-a2d4-2ce371b6c402 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:26.614039 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2562c8a1-e121-4004-a2d4-2ce371b6c402 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:26.614514 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2562c8a1-e121-4004-a2d4-2ce371b6c402 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:26.744892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2562c8a1-e121-4004-a2d4-2ce371b6c402 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:26.753017 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2562c8a1-e121-4004-a2d4-2ce371b6c402 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.153242 Aug 03 12:15:26.753598 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 249/524] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:26 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:27.099276 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f0dda4f6-f212-4797-8fb0-b735dff0cd51 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:27.099903 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f0dda4f6-f212-4797-8fb0-b735dff0cd51 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:27.106899 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f0dda4f6-f212-4797-8fb0-b735dff0cd51 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:27.107355 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f0dda4f6-f212-4797-8fb0-b735dff0cd51 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:27.108142 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f0dda4f6-f212-4797-8fb0-b735dff0cd51 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:27.108593 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f0dda4f6-f212-4797-8fb0-b735dff0cd51 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:27.255137 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f0dda4f6-f212-4797-8fb0-b735dff0cd51 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:27.269570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f0dda4f6-f212-4797-8fb0-b735dff0cd51 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1367 microversion: 2.1 time: 0.173517 Aug 03 12:15:27.270658 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 276/525] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:27 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:27.469525 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-36549ba4-eadb-44ff-bdb2-b47db5dbf02c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:27.470062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-36549ba4-eadb-44ff-bdb2-b47db5dbf02c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:27.476793 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-36549ba4-eadb-44ff-bdb2-b47db5dbf02c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:27.477248 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-36549ba4-eadb-44ff-bdb2-b47db5dbf02c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:27.478026 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-36549ba4-eadb-44ff-bdb2-b47db5dbf02c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:27.478480 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-36549ba4-eadb-44ff-bdb2-b47db5dbf02c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:27.636630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-36549ba4-eadb-44ff-bdb2-b47db5dbf02c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:27.644950 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-36549ba4-eadb-44ff-bdb2-b47db5dbf02c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.179900 Aug 03 12:15:27.645522 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 250/526] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:27 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:27.775621 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-362c5785-1be6-4e4c-86e0-3d5a11e6d8cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:27.776228 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-362c5785-1be6-4e4c-86e0-3d5a11e6d8cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:27.782525 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-362c5785-1be6-4e4c-86e0-3d5a11e6d8cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:27.782976 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-362c5785-1be6-4e4c-86e0-3d5a11e6d8cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:27.783759 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-362c5785-1be6-4e4c-86e0-3d5a11e6d8cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:27.784186 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-362c5785-1be6-4e4c-86e0-3d5a11e6d8cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:27.932012 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-7d045290-7d51-4a6f-a09c-55b59824accb req-d599f437-a22b-4c62-8e6e-3109b7417ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a", "name": "network-vif-plugged", "status": "completed", "tag": "f10aded2-66f3-4213-be84-e7efad0f47ed"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:27.942837 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-7d045290-7d51-4a6f-a09c-55b59824accb req-d599f437-a22b-4c62-8e6e-3109b7417ca4 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:27.944420 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-7d045290-7d51-4a6f-a09c-55b59824accb req-d599f437-a22b-4c62-8e6e-3109b7417ca4 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:27.956747 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-362c5785-1be6-4e4c-86e0-3d5a11e6d8cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:27.957216 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-7d045290-7d51-4a6f-a09c-55b59824accb req-d599f437-a22b-4c62-8e6e-3109b7417ca4 service nova] Creating event network-vif-plugged:f10aded2-66f3-4213-be84-e7efad0f47ed for instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a on hv-cinder-83602 Aug 03 12:15:27.962770 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-7d045290-7d51-4a6f-a09c-55b59824accb req-d599f437-a22b-4c62-8e6e-3109b7417ca4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034914 Aug 03 12:15:27.963544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 251/527] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:15:27.969642 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-362c5785-1be6-4e4c-86e0-3d5a11e6d8cd tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.198556 Aug 03 12:15:27.970236 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 277/528] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:27 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:28.292781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-83de2fa2-c5b9-449d-ab49-227ce99ae817 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:28.293498 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-83de2fa2-c5b9-449d-ab49-227ce99ae817 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:28.300538 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-83de2fa2-c5b9-449d-ab49-227ce99ae817 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:28.301046 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-83de2fa2-c5b9-449d-ab49-227ce99ae817 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:28.301854 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-83de2fa2-c5b9-449d-ab49-227ce99ae817 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:28.302299 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-83de2fa2-c5b9-449d-ab49-227ce99ae817 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:28.451550 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-83de2fa2-c5b9-449d-ab49-227ce99ae817 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:28.464106 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-83de2fa2-c5b9-449d-ab49-227ce99ae817 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1367 microversion: 2.1 time: 0.176390 Aug 03 12:15:28.465135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 252/529] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:28 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:28.667566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fb0a070b-c448-4424-b676-52b4f6a3546a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:28.668087 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fb0a070b-c448-4424-b676-52b4f6a3546a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:28.674701 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fb0a070b-c448-4424-b676-52b4f6a3546a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:28.675187 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fb0a070b-c448-4424-b676-52b4f6a3546a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:28.675965 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fb0a070b-c448-4424-b676-52b4f6a3546a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:28.676415 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fb0a070b-c448-4424-b676-52b4f6a3546a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:28.832798 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-fb0a070b-c448-4424-b676-52b4f6a3546a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:28.841743 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-fb0a070b-c448-4424-b676-52b4f6a3546a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.178638 Aug 03 12:15:28.842330 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 278/530] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:28 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:28.992970 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f867d9c6-3484-405d-ba71-f2ec8e74a9cf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:28.993626 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f867d9c6-3484-405d-ba71-f2ec8e74a9cf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:28.996097 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:28.996823 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=6 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:29.003778 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f867d9c6-3484-405d-ba71-f2ec8e74a9cf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:29.004231 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f867d9c6-3484-405d-ba71-f2ec8e74a9cf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:29.005021 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f867d9c6-3484-405d-ba71-f2ec8e74a9cf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:29.005464 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f867d9c6-3484-405d-ba71-f2ec8e74a9cf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:29.165805 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f867d9c6-3484-405d-ba71-f2ec8e74a9cf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:29.177416 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f867d9c6-3484-405d-ba71-f2ec8e74a9cf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.188375 Aug 03 12:15:29.178097 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 253/531] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:28 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:29.502848 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f8fdebd9-f0bc-4d07-a8c4-310c10f3994a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:29.503602 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f8fdebd9-f0bc-4d07-a8c4-310c10f3994a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:29.506205 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:29.514719 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8fdebd9-f0bc-4d07-a8c4-310c10f3994a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:29.515159 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8fdebd9-f0bc-4d07-a8c4-310c10f3994a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:29.516158 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8fdebd9-f0bc-4d07-a8c4-310c10f3994a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:29.516713 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8fdebd9-f0bc-4d07-a8c4-310c10f3994a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:29.672122 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f8fdebd9-f0bc-4d07-a8c4-310c10f3994a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:29.680877 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f8fdebd9-f0bc-4d07-a8c4-310c10f3994a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1367 microversion: 2.1 time: 0.185492 Aug 03 12:15:29.681468 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 279/532] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:29 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:29.864539 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-da7f5979-a66c-4c06-a245-3dc7c6cd7bc9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:29.865060 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-da7f5979-a66c-4c06-a245-3dc7c6cd7bc9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:29.871487 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-da7f5979-a66c-4c06-a245-3dc7c6cd7bc9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:29.871938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-da7f5979-a66c-4c06-a245-3dc7c6cd7bc9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:29.872997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-da7f5979-a66c-4c06-a245-3dc7c6cd7bc9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:29.874291 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-da7f5979-a66c-4c06-a245-3dc7c6cd7bc9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:30.044752 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-da7f5979-a66c-4c06-a245-3dc7c6cd7bc9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:30.062687 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-da7f5979-a66c-4c06-a245-3dc7c6cd7bc9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.201772 Aug 03 12:15:30.063483 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 254/533] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:29 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:30.207771 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fb8269d1-7d67-4a1b-83ec-94d6b149e5fa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:30.207771 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fb8269d1-7d67-4a1b-83ec-94d6b149e5fa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:30.212085 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fb8269d1-7d67-4a1b-83ec-94d6b149e5fa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:30.212535 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fb8269d1-7d67-4a1b-83ec-94d6b149e5fa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:30.213305 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fb8269d1-7d67-4a1b-83ec-94d6b149e5fa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:30.213740 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fb8269d1-7d67-4a1b-83ec-94d6b149e5fa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:30.355268 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-fb8269d1-7d67-4a1b-83ec-94d6b149e5fa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:30.363713 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-fb8269d1-7d67-4a1b-83ec-94d6b149e5fa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.164407 Aug 03 12:15:30.364369 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 280/534] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:30 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:30.702704 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-dbf6c8a6-83ae-4afb-856b-99f9378ba9d8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:30.703351 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-dbf6c8a6-83ae-4afb-856b-99f9378ba9d8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:30.710504 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dbf6c8a6-83ae-4afb-856b-99f9378ba9d8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:30.710950 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dbf6c8a6-83ae-4afb-856b-99f9378ba9d8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:30.711771 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dbf6c8a6-83ae-4afb-856b-99f9378ba9d8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:30.712249 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dbf6c8a6-83ae-4afb-856b-99f9378ba9d8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:30.857134 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dbf6c8a6-83ae-4afb-856b-99f9378ba9d8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:30.864919 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-dbf6c8a6-83ae-4afb-856b-99f9378ba9d8 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1557 microversion: 2.1 time: 0.166296 Aug 03 12:15:30.865507 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 255/535] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:30 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:30.889846 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-985256fa-9e8d-4444-9b09-648120bdaee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:30.890570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-985256fa-9e8d-4444-9b09-648120bdaee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:30.897997 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-985256fa-9e8d-4444-9b09-648120bdaee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:30.898602 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-985256fa-9e8d-4444-9b09-648120bdaee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:30.899404 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-985256fa-9e8d-4444-9b09-648120bdaee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:30.899835 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-985256fa-9e8d-4444-9b09-648120bdaee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:30.981417 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-985256fa-9e8d-4444-9b09-648120bdaee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097509 Aug 03 12:15:30.982429 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 281/536] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 3 12:15:30 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:15:31.085461 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7813b67e-2afc-4857-9704-05060f70371a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:31.085992 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7813b67e-2afc-4857-9704-05060f70371a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:31.092841 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7813b67e-2afc-4857-9704-05060f70371a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:31.093177 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7813b67e-2afc-4857-9704-05060f70371a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:31.093970 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7813b67e-2afc-4857-9704-05060f70371a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:31.094704 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7813b67e-2afc-4857-9704-05060f70371a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:31.262379 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7813b67e-2afc-4857-9704-05060f70371a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:31.271256 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7813b67e-2afc-4857-9704-05060f70371a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.189725 Aug 03 12:15:31.271870 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 256/537] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:31 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:31.388415 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-01d2d561-8391-40b3-9277-e1a40ad582aa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:31.390042 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-01d2d561-8391-40b3-9277-e1a40ad582aa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:31.395761 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-01d2d561-8391-40b3-9277-e1a40ad582aa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:31.396204 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-01d2d561-8391-40b3-9277-e1a40ad582aa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:31.397300 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-01d2d561-8391-40b3-9277-e1a40ad582aa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:31.398273 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-01d2d561-8391-40b3-9277-e1a40ad582aa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:31.603484 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-01d2d561-8391-40b3-9277-e1a40ad582aa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:31.613055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-01d2d561-8391-40b3-9277-e1a40ad582aa tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.230641 Aug 03 12:15:31.613701 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 282/538] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:31 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:32.310711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5e0af850-3169-43d3-9971-598d4187b4a7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:32.311501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5e0af850-3169-43d3-9971-598d4187b4a7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:32.320476 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e0af850-3169-43d3-9971-598d4187b4a7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:32.320932 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e0af850-3169-43d3-9971-598d4187b4a7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:32.321925 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e0af850-3169-43d3-9971-598d4187b4a7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:32.322233 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e0af850-3169-43d3-9971-598d4187b4a7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:32.364331 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-4721dbf6-35bc-451f-86b9-17e12ed8b72a req-39c97e1e-3209-4f19-8970-dacae3dd1d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a", "tag": "f10aded2-66f3-4213-be84-e7efad0f47ed"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:32.377180 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-4721dbf6-35bc-451f-86b9-17e12ed8b72a req-39c97e1e-3209-4f19-8970-dacae3dd1d1c service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:32.377689 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-4721dbf6-35bc-451f-86b9-17e12ed8b72a req-39c97e1e-3209-4f19-8970-dacae3dd1d1c service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:32.396337 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-4721dbf6-35bc-451f-86b9-17e12ed8b72a req-39c97e1e-3209-4f19-8970-dacae3dd1d1c service nova] Creating event network-changed:f10aded2-66f3-4213-be84-e7efad0f47ed for instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a on hv-cinder-83602 Aug 03 12:15:32.402961 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-4721dbf6-35bc-451f-86b9-17e12ed8b72a req-39c97e1e-3209-4f19-8970-dacae3dd1d1c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042292 Aug 03 12:15:32.403771 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 283/539] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:15:32.480078 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5e0af850-3169-43d3-9971-598d4187b4a7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:32.493756 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5e0af850-3169-43d3-9971-598d4187b4a7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.186860 Aug 03 12:15:32.494904 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 257/540] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:32 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:32.635695 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3fe99f1a-b08e-4ccf-b7a4-f7571c05fa71 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:32.636586 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3fe99f1a-b08e-4ccf-b7a4-f7571c05fa71 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:32.643121 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3fe99f1a-b08e-4ccf-b7a4-f7571c05fa71 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:32.643578 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3fe99f1a-b08e-4ccf-b7a4-f7571c05fa71 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:32.644687 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3fe99f1a-b08e-4ccf-b7a4-f7571c05fa71 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:32.645476 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3fe99f1a-b08e-4ccf-b7a4-f7571c05fa71 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:32.877308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3fe99f1a-b08e-4ccf-b7a4-f7571c05fa71 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:32.881403 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:32.891029 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3fe99f1a-b08e-4ccf-b7a4-f7571c05fa71 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.259922 Aug 03 12:15:32.892257 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 284/541] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:32 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:33.516988 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-bff724ae-01c5-4fdb-9fe1-2ef10cc2a220 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:33.517479 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-bff724ae-01c5-4fdb-9fe1-2ef10cc2a220 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:33.524827 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bff724ae-01c5-4fdb-9fe1-2ef10cc2a220 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:33.525278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bff724ae-01c5-4fdb-9fe1-2ef10cc2a220 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:33.526054 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bff724ae-01c5-4fdb-9fe1-2ef10cc2a220 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:33.526516 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bff724ae-01c5-4fdb-9fe1-2ef10cc2a220 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:33.683780 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-bff724ae-01c5-4fdb-9fe1-2ef10cc2a220 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:33.692154 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-bff724ae-01c5-4fdb-9fe1-2ef10cc2a220 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.179604 Aug 03 12:15:33.692732 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 258/542] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:33 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:33.914723 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7851895a-73cf-493c-be19-61aba751b6d5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:33.915301 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7851895a-73cf-493c-be19-61aba751b6d5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:33.923379 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7851895a-73cf-493c-be19-61aba751b6d5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:33.923825 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7851895a-73cf-493c-be19-61aba751b6d5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:33.924641 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7851895a-73cf-493c-be19-61aba751b6d5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:33.925103 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7851895a-73cf-493c-be19-61aba751b6d5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:34.068909 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7851895a-73cf-493c-be19-61aba751b6d5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:34.077514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7851895a-73cf-493c-be19-61aba751b6d5 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.167562 Aug 03 12:15:34.078107 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 285/543] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:33 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:34.714217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-46b00b3c-7ed9-4431-b26e-ea2dc42293ef tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:34.714799 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-46b00b3c-7ed9-4431-b26e-ea2dc42293ef tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:34.721609 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46b00b3c-7ed9-4431-b26e-ea2dc42293ef tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:34.722054 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46b00b3c-7ed9-4431-b26e-ea2dc42293ef tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:34.722858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46b00b3c-7ed9-4431-b26e-ea2dc42293ef tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:34.723294 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46b00b3c-7ed9-4431-b26e-ea2dc42293ef tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:34.864263 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-46b00b3c-7ed9-4431-b26e-ea2dc42293ef tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:34.872835 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-46b00b3c-7ed9-4431-b26e-ea2dc42293ef tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.162614 Aug 03 12:15:34.873402 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 259/544] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:34 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:35.101498 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8476fcd3-90b0-4651-9722-89597b48df1b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:35.102129 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8476fcd3-90b0-4651-9722-89597b48df1b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:35.108756 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8476fcd3-90b0-4651-9722-89597b48df1b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:35.109210 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8476fcd3-90b0-4651-9722-89597b48df1b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:35.110178 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8476fcd3-90b0-4651-9722-89597b48df1b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:35.110483 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8476fcd3-90b0-4651-9722-89597b48df1b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:35.247443 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8476fcd3-90b0-4651-9722-89597b48df1b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:35.255996 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8476fcd3-90b0-4651-9722-89597b48df1b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.160004 Aug 03 12:15:35.256581 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 286/545] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:35 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:35.894296 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-86d63735-8f35-4180-a775-0ae80e18dfd9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:35.895105 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-86d63735-8f35-4180-a775-0ae80e18dfd9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:35.902062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-86d63735-8f35-4180-a775-0ae80e18dfd9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:35.902549 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-86d63735-8f35-4180-a775-0ae80e18dfd9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:35.903342 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-86d63735-8f35-4180-a775-0ae80e18dfd9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:35.903781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-86d63735-8f35-4180-a775-0ae80e18dfd9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:36.064541 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-86d63735-8f35-4180-a775-0ae80e18dfd9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:36.073728 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-86d63735-8f35-4180-a775-0ae80e18dfd9 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.183780 Aug 03 12:15:36.074332 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 260/546] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:35 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:36.278562 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d299e43e-8687-409d-8ef2-47623ee448d6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:36.279246 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d299e43e-8687-409d-8ef2-47623ee448d6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:36.286983 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d299e43e-8687-409d-8ef2-47623ee448d6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:36.287511 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d299e43e-8687-409d-8ef2-47623ee448d6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:36.288806 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d299e43e-8687-409d-8ef2-47623ee448d6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:36.289246 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d299e43e-8687-409d-8ef2-47623ee448d6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:36.442861 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d299e43e-8687-409d-8ef2-47623ee448d6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:36.451437 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d299e43e-8687-409d-8ef2-47623ee448d6 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.176953 Aug 03 12:15:36.452025 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 287/547] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:36 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:37.097330 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d532ba7f-c1eb-4c46-b64e-e30343d3f990 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:37.098217 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d532ba7f-c1eb-4c46-b64e-e30343d3f990 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:37.107159 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d532ba7f-c1eb-4c46-b64e-e30343d3f990 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:37.107722 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d532ba7f-c1eb-4c46-b64e-e30343d3f990 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:37.108749 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d532ba7f-c1eb-4c46-b64e-e30343d3f990 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:37.109373 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d532ba7f-c1eb-4c46-b64e-e30343d3f990 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:37.282386 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d532ba7f-c1eb-4c46-b64e-e30343d3f990 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:37.288716 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=100 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:37.301344 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d532ba7f-c1eb-4c46-b64e-e30343d3f990 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.207980 Aug 03 12:15:37.302893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 261/548] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:37 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:37.473958 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-aa669cee-3ab9-409e-a602-9f47682fd4de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:37.474724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-aa669cee-3ab9-409e-a602-9f47682fd4de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:37.477290 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:37.484500 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-aa669cee-3ab9-409e-a602-9f47682fd4de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:37.484712 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-aa669cee-3ab9-409e-a602-9f47682fd4de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:37.485998 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-aa669cee-3ab9-409e-a602-9f47682fd4de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:37.485998 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-aa669cee-3ab9-409e-a602-9f47682fd4de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:37.645064 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-aa669cee-3ab9-409e-a602-9f47682fd4de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:37.657206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-aa669cee-3ab9-409e-a602-9f47682fd4de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.187303 Aug 03 12:15:37.657825 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 288/549] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:37 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:38.326622 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b50d892e-6a90-4579-8ffe-b606e9c7f829 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:38.327284 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b50d892e-6a90-4579-8ffe-b606e9c7f829 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:38.334713 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b50d892e-6a90-4579-8ffe-b606e9c7f829 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:38.335147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b50d892e-6a90-4579-8ffe-b606e9c7f829 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:38.335938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b50d892e-6a90-4579-8ffe-b606e9c7f829 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:38.336376 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b50d892e-6a90-4579-8ffe-b606e9c7f829 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:38.520367 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b50d892e-6a90-4579-8ffe-b606e9c7f829 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:38.531785 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b50d892e-6a90-4579-8ffe-b606e9c7f829 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.209040 Aug 03 12:15:38.532565 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 262/550] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:38 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:38.689462 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-02871c71-28c6-43f1-ac39-306b219ebd77 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:38.690146 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-02871c71-28c6-43f1-ac39-306b219ebd77 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:38.698300 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-02871c71-28c6-43f1-ac39-306b219ebd77 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:38.698876 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-02871c71-28c6-43f1-ac39-306b219ebd77 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:38.699815 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-02871c71-28c6-43f1-ac39-306b219ebd77 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:38.700337 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-02871c71-28c6-43f1-ac39-306b219ebd77 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:38.865043 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-02871c71-28c6-43f1-ac39-306b219ebd77 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:38.880740 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-02871c71-28c6-43f1-ac39-306b219ebd77 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.195755 Aug 03 12:15:38.882431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 289/551] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:38 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:39.559038 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-91e98a1d-bdf9-4410-835b-64d42ac507c6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:39.560121 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-91e98a1d-bdf9-4410-835b-64d42ac507c6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:39.572222 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-91e98a1d-bdf9-4410-835b-64d42ac507c6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:39.573032 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-91e98a1d-bdf9-4410-835b-64d42ac507c6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:39.574478 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-91e98a1d-bdf9-4410-835b-64d42ac507c6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:39.575267 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-91e98a1d-bdf9-4410-835b-64d42ac507c6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:39.749489 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-91e98a1d-bdf9-4410-835b-64d42ac507c6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:39.761926 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-91e98a1d-bdf9-4410-835b-64d42ac507c6 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.210929 Aug 03 12:15:39.762549 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 263/552] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:39 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:39.918580 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a2be5bac-531b-4535-a0d2-001e5bac5b44 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:39.919215 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a2be5bac-531b-4535-a0d2-001e5bac5b44 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:39.926036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a2be5bac-531b-4535-a0d2-001e5bac5b44 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:39.926521 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a2be5bac-531b-4535-a0d2-001e5bac5b44 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:39.927320 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a2be5bac-531b-4535-a0d2-001e5bac5b44 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:39.927773 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a2be5bac-531b-4535-a0d2-001e5bac5b44 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:40.108398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a2be5bac-531b-4535-a0d2-001e5bac5b44 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:40.122830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a2be5bac-531b-4535-a0d2-001e5bac5b44 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1736 microversion: 2.1 time: 0.208807 Aug 03 12:15:40.123421 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 290/553] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:39 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:40.799771 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a2eaa977-a8e6-41ed-9b65-2ac79bfdbae7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:40.800745 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a2eaa977-a8e6-41ed-9b65-2ac79bfdbae7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:40.805312 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:40.814700 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a2eaa977-a8e6-41ed-9b65-2ac79bfdbae7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:40.815480 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a2eaa977-a8e6-41ed-9b65-2ac79bfdbae7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:40.816949 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a2eaa977-a8e6-41ed-9b65-2ac79bfdbae7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:40.817795 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a2eaa977-a8e6-41ed-9b65-2ac79bfdbae7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:41.062546 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a2eaa977-a8e6-41ed-9b65-2ac79bfdbae7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:41.072375 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a2eaa977-a8e6-41ed-9b65-2ac79bfdbae7 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.280099 Aug 03 12:15:41.072973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 264/554] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:40 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:41.150986 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bbef6de7-8e57-4489-be80-904f588df975 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:41.151717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bbef6de7-8e57-4489-be80-904f588df975 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:41.159139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bbef6de7-8e57-4489-be80-904f588df975 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:41.159573 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bbef6de7-8e57-4489-be80-904f588df975 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:41.160371 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bbef6de7-8e57-4489-be80-904f588df975 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:41.160811 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bbef6de7-8e57-4489-be80-904f588df975 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:41.285898 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e93f76a8-5627-4603-8a85-1593ed47932e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:41.286900 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e93f76a8-5627-4603-8a85-1593ed47932e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:41.299541 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e93f76a8-5627-4603-8a85-1593ed47932e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:41.300658 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e93f76a8-5627-4603-8a85-1593ed47932e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:41.302014 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e93f76a8-5627-4603-8a85-1593ed47932e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:41.302829 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e93f76a8-5627-4603-8a85-1593ed47932e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:41.337465 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bbef6de7-8e57-4489-be80-904f588df975 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:41.353548 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bbef6de7-8e57-4489-be80-904f588df975 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1716 microversion: 2.1 time: 0.207058 Aug 03 12:15:41.355030 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 291/555] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:41 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1716 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:41.405603 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-e93f76a8-5627-4603-8a85-1593ed47932e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lazy-loading 'services' on Instance uuid ed09302a-b62b-4353-976f-e47444e0dda4 {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:15:41.524600 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e93f76a8-5627-4603-8a85-1593ed47932e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/os-volume_attachments/a725cf3d-3788-4fbc-8f2b-e4331db0f97c" status: 202 len: 0 microversion: 2.1 time: 0.249533 Aug 03 12:15:41.526560 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 265/556] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 3 12:15:41 2022] DELETE /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/os-volume_attachments/a725cf3d-3788-4fbc-8f2b-e4331db0f97c => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 12:15:41.532048 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b87dbd1d-19ec-4c2b-bde8-810c969cfa26 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:41.532556 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b87dbd1d-19ec-4c2b-bde8-810c969cfa26 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:41.541654 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b87dbd1d-19ec-4c2b-bde8-810c969cfa26 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:41.542418 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b87dbd1d-19ec-4c2b-bde8-810c969cfa26 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:41.543596 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b87dbd1d-19ec-4c2b-bde8-810c969cfa26 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:41.544353 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b87dbd1d-19ec-4c2b-bde8-810c969cfa26 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:41.728950 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-b87dbd1d-19ec-4c2b-bde8-810c969cfa26 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] HTTP exception thrown: Cannot 'detach_volume' instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 while it is in vm_state rescued Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b87dbd1d-19ec-4c2b-bde8-810c969cfa26 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Request method failure captured: Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: DELETE /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-volume_attachments/c97255cd-621a-49f8-b1e9-ac08182dbd96 HTTP/1.1 Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXpGgstOLCAy1IlP8axU4h3RqjCWiCOjN6ADxKbHRwEqWKAJbyQSVt-GY6L_iKrgzC0QBQEwSacUOcec64z9asz0SHu9FitUawVbzLJtXhCKgLQERKvuYBNI9_B_4tm1yF1ahiKM6J-qYB618EPmimAvbmvR6h-16Prn4spPy7fhlo Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: d51be67fb4974085b55f3dcfcc2c70aa Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:15:41.732222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:15:41.733784 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d51be67fb4974085b55f3dcfcc2c70aa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:15:41.733784 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:15:41.733784 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: d51be67fb4974085b55f3dcfcc2c70aa Aug 03 12:15:41.733784 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:15:41.733784 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-ServerRescueNegativeTestJSON-350268690-project Aug 03 12:15:41.733784 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:15:41.733784 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:15:41.733784 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: cde9db32ba1c4810833f8fd824536347 Aug 03 12:15:41.733784 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-ServerRescueNegativeTestJSON-350268690-project Aug 03 12:15:41.733784 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:15:41.733784 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Cannot 'detach_volume' instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 while it is in vm_state rescued Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'server_id': '2b98bd00-4a41-43d7-a5c6-ff4644582d13', 'id': 'c97255cd-621a-49f8-b1e9-ac08182dbd96'} Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:15:41.734653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 while it is in vm_state rescued Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 while it is in vm_state rescued Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:15:41.736071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b87dbd1d-19ec-4c2b-bde8-810c969cfa26 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Returning 409 to user: Cannot 'detach_volume' instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 while it is in vm_state rescued {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:15:41.737010 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b87dbd1d-19ec-4c2b-bde8-810c969cfa26 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-volume_attachments/c97255cd-621a-49f8-b1e9-ac08182dbd96" status: 409 len: 152 microversion: 2.1 time: 0.209179 Aug 03 12:15:41.737010 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 292/557] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 3 12:15:41 2022] DELETE /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-volume_attachments/c97255cd-621a-49f8-b1e9-ac08182dbd96 => generated 152 bytes in 212 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 03 12:15:41.745235 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-71e649bf-4b8b-4f9a-934a-a564e6a6f05a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:41.745863 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-71e649bf-4b8b-4f9a-934a-a564e6a6f05a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:41.752522 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71e649bf-4b8b-4f9a-934a-a564e6a6f05a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:41.752978 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71e649bf-4b8b-4f9a-934a-a564e6a6f05a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:41.753768 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71e649bf-4b8b-4f9a-934a-a564e6a6f05a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:41.754207 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-71e649bf-4b8b-4f9a-934a-a564e6a6f05a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:41.828705 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-71e649bf-4b8b-4f9a-934a-a564e6a6f05a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "POST /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/action" status: 202 len: 0 microversion: 2.1 time: 0.087575 Aug 03 12:15:41.829395 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 266/558] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:15:41 2022] POST /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:15:41.839202 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-45f931e7-529c-4ccc-b0e8-cfcf4e57e079 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:41.840027 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-45f931e7-529c-4ccc-b0e8-cfcf4e57e079 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:41.848266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45f931e7-529c-4ccc-b0e8-cfcf4e57e079 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:41.848822 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45f931e7-529c-4ccc-b0e8-cfcf4e57e079 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:41.849738 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45f931e7-529c-4ccc-b0e8-cfcf4e57e079 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:41.850167 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45f931e7-529c-4ccc-b0e8-cfcf4e57e079 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:41.995416 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-45f931e7-529c-4ccc-b0e8-cfcf4e57e079 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:42.010626 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-45f931e7-529c-4ccc-b0e8-cfcf4e57e079 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1724 microversion: 2.1 time: 0.170241 Aug 03 12:15:42.010626 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 293/559] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:41 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:42.108017 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4667afde-19b4-44c8-99f6-7f5cc7220afb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:42.109132 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-4667afde-19b4-44c8-99f6-7f5cc7220afb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:42.120424 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4667afde-19b4-44c8-99f6-7f5cc7220afb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:42.121200 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4667afde-19b4-44c8-99f6-7f5cc7220afb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:42.122429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4667afde-19b4-44c8-99f6-7f5cc7220afb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:42.123226 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4667afde-19b4-44c8-99f6-7f5cc7220afb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:42.352844 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-4667afde-19b4-44c8-99f6-7f5cc7220afb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:42.361918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-4667afde-19b4-44c8-99f6-7f5cc7220afb tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.260612 Aug 03 12:15:42.362420 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 267/560] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:42 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:42.722127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c66cc1de-1d0a-45a7-b307-32131bd7a9fb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:42.731482 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c66cc1de-1d0a-45a7-b307-32131bd7a9fb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:42.732253 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c66cc1de-1d0a-45a7-b307-32131bd7a9fb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:42.761214 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c66cc1de-1d0a-45a7-b307-32131bd7a9fb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Going to try to stop instance {{(pid=117910) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 12:15:42.817192 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c66cc1de-1d0a-45a7-b307-32131bd7a9fb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "POST /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/action" status: 202 len: 0 microversion: 2.1 time: 0.099886 Aug 03 12:15:42.818029 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 294/561] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:15:42 2022] POST /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:15:42.829933 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-23ac41c3-109f-46d2-bc17-d4858dcd748a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:42.831477 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-23ac41c3-109f-46d2-bc17-d4858dcd748a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:42.839851 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-23ac41c3-109f-46d2-bc17-d4858dcd748a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:42.840435 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-23ac41c3-109f-46d2-bc17-d4858dcd748a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:42.841857 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-23ac41c3-109f-46d2-bc17-d4858dcd748a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:42.842544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-23ac41c3-109f-46d2-bc17-d4858dcd748a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:43.012484 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-23ac41c3-109f-46d2-bc17-d4858dcd748a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:43.020694 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-23ac41c3-109f-46d2-bc17-d4858dcd748a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1675 microversion: 2.1 time: 0.196725 Aug 03 12:15:43.021284 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 268/562] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:42 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:43.041855 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f5287f6d-6aad-4304-86c7-ad0e4de6b5e1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:43.042625 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f5287f6d-6aad-4304-86c7-ad0e4de6b5e1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:43.050038 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f5287f6d-6aad-4304-86c7-ad0e4de6b5e1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:43.050514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f5287f6d-6aad-4304-86c7-ad0e4de6b5e1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:43.051565 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f5287f6d-6aad-4304-86c7-ad0e4de6b5e1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:43.052007 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f5287f6d-6aad-4304-86c7-ad0e4de6b5e1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:43.219150 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f5287f6d-6aad-4304-86c7-ad0e4de6b5e1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:43.239547 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f5287f6d-6aad-4304-86c7-ad0e4de6b5e1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1724 microversion: 2.1 time: 0.201743 Aug 03 12:15:43.241650 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 295/563] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:43 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:43.397707 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ce3e1faa-c094-4fc6-bc7f-b04e686f8f21 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:43.398262 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-ce3e1faa-c094-4fc6-bc7f-b04e686f8f21 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:43.405159 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ce3e1faa-c094-4fc6-bc7f-b04e686f8f21 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:43.405602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ce3e1faa-c094-4fc6-bc7f-b04e686f8f21 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:43.406391 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ce3e1faa-c094-4fc6-bc7f-b04e686f8f21 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:43.406858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ce3e1faa-c094-4fc6-bc7f-b04e686f8f21 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:43.581510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ce3e1faa-c094-4fc6-bc7f-b04e686f8f21 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:43.591431 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ce3e1faa-c094-4fc6-bc7f-b04e686f8f21 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.198414 Aug 03 12:15:43.592214 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 269/564] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:43 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:44.045377 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-db47756f-1ce7-4ceb-a1b2-8aaeaa3667f3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:44.046511 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-db47756f-1ce7-4ceb-a1b2-8aaeaa3667f3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:44.054664 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-db47756f-1ce7-4ceb-a1b2-8aaeaa3667f3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:44.055117 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-db47756f-1ce7-4ceb-a1b2-8aaeaa3667f3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:44.055909 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-db47756f-1ce7-4ceb-a1b2-8aaeaa3667f3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:44.056346 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-db47756f-1ce7-4ceb-a1b2-8aaeaa3667f3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:44.214400 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-db47756f-1ce7-4ceb-a1b2-8aaeaa3667f3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:44.223013 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-db47756f-1ce7-4ceb-a1b2-8aaeaa3667f3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1675 microversion: 2.1 time: 0.183228 Aug 03 12:15:44.224508 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 296/565] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:44 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:44.263756 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-830aac0c-1425-488e-ba38-0ffb451608f0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:44.264403 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-830aac0c-1425-488e-ba38-0ffb451608f0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:44.271941 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-830aac0c-1425-488e-ba38-0ffb451608f0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:44.272551 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-830aac0c-1425-488e-ba38-0ffb451608f0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:44.273443 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-830aac0c-1425-488e-ba38-0ffb451608f0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:44.274005 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-830aac0c-1425-488e-ba38-0ffb451608f0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:44.434025 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-830aac0c-1425-488e-ba38-0ffb451608f0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:44.450301 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-830aac0c-1425-488e-ba38-0ffb451608f0 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1724 microversion: 2.1 time: 0.189929 Aug 03 12:15:44.451454 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 270/566] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:44 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:44.618648 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a12162e1-1f67-42c4-89ab-1d4cd608d22c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:44.620421 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a12162e1-1f67-42c4-89ab-1d4cd608d22c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:44.629058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a12162e1-1f67-42c4-89ab-1d4cd608d22c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:44.629831 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a12162e1-1f67-42c4-89ab-1d4cd608d22c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:44.631028 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a12162e1-1f67-42c4-89ab-1d4cd608d22c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:44.631866 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a12162e1-1f67-42c4-89ab-1d4cd608d22c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:44.837609 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a12162e1-1f67-42c4-89ab-1d4cd608d22c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:44.846596 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a12162e1-1f67-42c4-89ab-1d4cd608d22c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.233674 Aug 03 12:15:44.847174 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 297/567] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:44 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:45.245669 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b7e8a6e5-8488-46dc-9a87-8e6a009fdec2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:45.246286 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b7e8a6e5-8488-46dc-9a87-8e6a009fdec2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:45.254008 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b7e8a6e5-8488-46dc-9a87-8e6a009fdec2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:45.254008 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b7e8a6e5-8488-46dc-9a87-8e6a009fdec2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:45.254693 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b7e8a6e5-8488-46dc-9a87-8e6a009fdec2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:45.255170 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b7e8a6e5-8488-46dc-9a87-8e6a009fdec2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:45.423391 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b7e8a6e5-8488-46dc-9a87-8e6a009fdec2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:45.431405 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b7e8a6e5-8488-46dc-9a87-8e6a009fdec2 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1675 microversion: 2.1 time: 0.189656 Aug 03 12:15:45.432005 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 271/568] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:45 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1675 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:45.472951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ff4deb34-d2b9-4e84-b8a8-27e1416d3cd2 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:45.473686 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ff4deb34-d2b9-4e84-b8a8-27e1416d3cd2 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:45.480679 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ff4deb34-d2b9-4e84-b8a8-27e1416d3cd2 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:45.481446 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ff4deb34-d2b9-4e84-b8a8-27e1416d3cd2 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:45.482269 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ff4deb34-d2b9-4e84-b8a8-27e1416d3cd2 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:45.482764 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ff4deb34-d2b9-4e84-b8a8-27e1416d3cd2 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:45.647482 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ff4deb34-d2b9-4e84-b8a8-27e1416d3cd2 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:45.656612 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ff4deb34-d2b9-4e84-b8a8-27e1416d3cd2 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1724 microversion: 2.1 time: 0.187541 Aug 03 12:15:45.657212 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 298/569] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:45 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:45.870518 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7987b24f-b9be-45ba-a983-b5dc9f7d238e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:45.871142 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7987b24f-b9be-45ba-a983-b5dc9f7d238e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:45.883156 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7987b24f-b9be-45ba-a983-b5dc9f7d238e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:45.883605 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7987b24f-b9be-45ba-a983-b5dc9f7d238e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:45.884391 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7987b24f-b9be-45ba-a983-b5dc9f7d238e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:45.884822 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7987b24f-b9be-45ba-a983-b5dc9f7d238e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:46.058788 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7987b24f-b9be-45ba-a983-b5dc9f7d238e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:46.069481 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7987b24f-b9be-45ba-a983-b5dc9f7d238e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1755 microversion: 2.1 time: 0.203290 Aug 03 12:15:46.070075 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 272/570] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:45 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:46.457874 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8f39bf19-17e1-41aa-aaa1-af10a9f38dd9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:46.459538 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8f39bf19-17e1-41aa-aaa1-af10a9f38dd9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:46.468018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f39bf19-17e1-41aa-aaa1-af10a9f38dd9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:46.468655 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f39bf19-17e1-41aa-aaa1-af10a9f38dd9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:46.470292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f39bf19-17e1-41aa-aaa1-af10a9f38dd9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:46.470967 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8f39bf19-17e1-41aa-aaa1-af10a9f38dd9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:46.661999 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8f39bf19-17e1-41aa-aaa1-af10a9f38dd9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:46.671524 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8f39bf19-17e1-41aa-aaa1-af10a9f38dd9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1675 microversion: 2.1 time: 0.220389 Aug 03 12:15:46.672195 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 299/571] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:46 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1675 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:46.683390 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d915efc5-504b-4a54-a41d-f31fb5a3d851 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:46.684419 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d915efc5-504b-4a54-a41d-f31fb5a3d851 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:46.691250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d915efc5-504b-4a54-a41d-f31fb5a3d851 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:46.691937 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d915efc5-504b-4a54-a41d-f31fb5a3d851 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:46.692704 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d915efc5-504b-4a54-a41d-f31fb5a3d851 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:46.693160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d915efc5-504b-4a54-a41d-f31fb5a3d851 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:46.869524 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d915efc5-504b-4a54-a41d-f31fb5a3d851 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:46.882051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d915efc5-504b-4a54-a41d-f31fb5a3d851 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1730 microversion: 2.1 time: 0.203087 Aug 03 12:15:46.882985 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 273/572] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:46 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:46.906417 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-80a37c64-d014-47a2-b266-f0f06ff07e64 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:46.907500 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-80a37c64-d014-47a2-b266-f0f06ff07e64 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:46.915931 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80a37c64-d014-47a2-b266-f0f06ff07e64 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:46.916380 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80a37c64-d014-47a2-b266-f0f06ff07e64 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:46.917244 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80a37c64-d014-47a2-b266-f0f06ff07e64 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:46.917678 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80a37c64-d014-47a2-b266-f0f06ff07e64 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:46.933395 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:47.010891 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-80a37c64-d014-47a2-b266-f0f06ff07e64 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108643 Aug 03 12:15:47.011796 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 300/573] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 3 12:15:46 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:15:47.094853 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-33da0d4a-c05a-4876-a624-1c3c0ae76d7a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:47.096384 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-33da0d4a-c05a-4876-a624-1c3c0ae76d7a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:47.108193 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-33da0d4a-c05a-4876-a624-1c3c0ae76d7a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:47.108703 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-33da0d4a-c05a-4876-a624-1c3c0ae76d7a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:47.110045 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-33da0d4a-c05a-4876-a624-1c3c0ae76d7a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:47.111053 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-33da0d4a-c05a-4876-a624-1c3c0ae76d7a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:47.292113 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-33da0d4a-c05a-4876-a624-1c3c0ae76d7a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:47.307540 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-33da0d4a-c05a-4876-a624-1c3c0ae76d7a tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1758 microversion: 2.1 time: 0.218818 Aug 03 12:15:47.308435 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 274/574] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:47 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1758 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:47.701577 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ecb334c4-d6a2-4f4c-a5e7-d5276e8a51bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:47.702755 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ecb334c4-d6a2-4f4c-a5e7-d5276e8a51bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:47.713240 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ecb334c4-d6a2-4f4c-a5e7-d5276e8a51bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:47.714046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ecb334c4-d6a2-4f4c-a5e7-d5276e8a51bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:47.715580 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ecb334c4-d6a2-4f4c-a5e7-d5276e8a51bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:47.716347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ecb334c4-d6a2-4f4c-a5e7-d5276e8a51bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:47.965470 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ecb334c4-d6a2-4f4c-a5e7-d5276e8a51bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:47.980573 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ecb334c4-d6a2-4f4c-a5e7-d5276e8a51bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1675 microversion: 2.1 time: 0.287521 Aug 03 12:15:47.981865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 301/575] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:47 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1675 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:15:48.574347 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-5abbf3f3-e205-4745-9006-f835a2372f15 req-bf4d3b14-1be4-4811-b785-4170d753ca76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b98bd00-4a41-43d7-a5c6-ff4644582d13", "tag": "2946f3bb-8068-403a-8fc7-8e8c09e8d7c8"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:48.587818 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-5abbf3f3-e205-4745-9006-f835a2372f15 req-bf4d3b14-1be4-4811-b785-4170d753ca76 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:48.588255 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-5abbf3f3-e205-4745-9006-f835a2372f15 req-bf4d3b14-1be4-4811-b785-4170d753ca76 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:48.601634 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-5abbf3f3-e205-4745-9006-f835a2372f15 req-bf4d3b14-1be4-4811-b785-4170d753ca76 service nova] Creating event network-changed:2946f3bb-8068-403a-8fc7-8e8c09e8d7c8 for instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 on hv-cinder-83602 Aug 03 12:15:48.618601 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-5abbf3f3-e205-4745-9006-f835a2372f15 req-bf4d3b14-1be4-4811-b785-4170d753ca76 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049371 Aug 03 12:15:48.620629 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 275/576] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:15:49.005657 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-36fe2bbf-0cff-40b9-bdc2-f4ce8524d302 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:49.006687 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-36fe2bbf-0cff-40b9-bdc2-f4ce8524d302 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:49.013487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-36fe2bbf-0cff-40b9-bdc2-f4ce8524d302 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:49.014234 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-36fe2bbf-0cff-40b9-bdc2-f4ce8524d302 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:49.015589 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-36fe2bbf-0cff-40b9-bdc2-f4ce8524d302 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:49.016195 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-36fe2bbf-0cff-40b9-bdc2-f4ce8524d302 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:49.118804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-af595027-e430-459f-a6fd-22cf987ba48e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:49.119846 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-af595027-e430-459f-a6fd-22cf987ba48e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:49.132387 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-af595027-e430-459f-a6fd-22cf987ba48e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:49.133200 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-af595027-e430-459f-a6fd-22cf987ba48e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:49.134614 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-af595027-e430-459f-a6fd-22cf987ba48e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:49.135393 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-af595027-e430-459f-a6fd-22cf987ba48e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:49.203920 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-af595027-e430-459f-a6fd-22cf987ba48e tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/os-volume_attachments/8e1ff698-cbe6-47e8-8f8d-92b2f6e2e939" status: 200 len: 194 microversion: 2.20 time: 0.096869 Aug 03 12:15:49.205262 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 276/577] 10.222.0.17 () {60 vars in 1454 bytes} [Wed Aug 3 12:15:49 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/os-volume_attachments/8e1ff698-cbe6-47e8-8f8d-92b2f6e2e939 => generated 194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:15:49.216654 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-36fe2bbf-0cff-40b9-bdc2-f4ce8524d302 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:49.234107 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-36fe2bbf-0cff-40b9-bdc2-f4ce8524d302 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1675 microversion: 2.1 time: 0.232513 Aug 03 12:15:49.247180 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 302/578] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:49 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:49.299682 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e1c3eb43-79a2-41b2-ad96-28f6dc7f045c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:49.300191 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e1c3eb43-79a2-41b2-ad96-28f6dc7f045c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:49.307567 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e1c3eb43-79a2-41b2-ad96-28f6dc7f045c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:49.308023 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e1c3eb43-79a2-41b2-ad96-28f6dc7f045c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:49.308818 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e1c3eb43-79a2-41b2-ad96-28f6dc7f045c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:49.309620 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e1c3eb43-79a2-41b2-ad96-28f6dc7f045c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:49.329927 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:15:49.418386 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-e1c3eb43-79a2-41b2-ad96-28f6dc7f045c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lazy-loading 'services' on Instance uuid 4afb38cd-ec9c-4509-b7c8-91b170684ec5 {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:15:49.513540 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e1c3eb43-79a2-41b2-ad96-28f6dc7f045c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/os-volume_attachments/8e1ff698-cbe6-47e8-8f8d-92b2f6e2e939" status: 202 len: 0 microversion: 2.20 time: 0.219028 Aug 03 12:15:49.514530 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 277/579] 10.222.0.17 () {60 vars in 1457 bytes} [Wed Aug 3 12:15:49 2022] DELETE /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/os-volume_attachments/8e1ff698-cbe6-47e8-8f8d-92b2f6e2e939 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:15:49.527664 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cac7315a-04ca-4d6a-906c-93c8f0f65e14 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:49.531373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cac7315a-04ca-4d6a-906c-93c8f0f65e14 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:49.540812 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cac7315a-04ca-4d6a-906c-93c8f0f65e14 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:49.541380 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cac7315a-04ca-4d6a-906c-93c8f0f65e14 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:49.542869 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cac7315a-04ca-4d6a-906c-93c8f0f65e14 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:49.543509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cac7315a-04ca-4d6a-906c-93c8f0f65e14 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:49.586468 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cac7315a-04ca-4d6a-906c-93c8f0f65e14 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066502 Aug 03 12:15:49.587421 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 303/580] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 3 12:15:49 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:15:50.269300 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-405c441a-57ba-4899-8794-b2bdbdce03b8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:50.270013 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-405c441a-57ba-4899-8794-b2bdbdce03b8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:50.276836 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-405c441a-57ba-4899-8794-b2bdbdce03b8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:50.277294 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-405c441a-57ba-4899-8794-b2bdbdce03b8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:50.278093 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-405c441a-57ba-4899-8794-b2bdbdce03b8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:50.278590 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-405c441a-57ba-4899-8794-b2bdbdce03b8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:50.423116 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-405c441a-57ba-4899-8794-b2bdbdce03b8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:50.439436 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-405c441a-57ba-4899-8794-b2bdbdce03b8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1675 microversion: 2.1 time: 0.174794 Aug 03 12:15:50.440516 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 278/581] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:50 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:50.599454 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c933c3d4-ece6-4dee-8d8d-5bcdc6c0a9d7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:50.602194 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c933c3d4-ece6-4dee-8d8d-5bcdc6c0a9d7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:50.609600 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c933c3d4-ece6-4dee-8d8d-5bcdc6c0a9d7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:50.610052 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c933c3d4-ece6-4dee-8d8d-5bcdc6c0a9d7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:50.610898 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c933c3d4-ece6-4dee-8d8d-5bcdc6c0a9d7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:50.611346 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c933c3d4-ece6-4dee-8d8d-5bcdc6c0a9d7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:50.640743 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-77a9d7df-83ad-4d71-87cf-a253de1ff8da req-7ba09159-d87b-4ccb-9ffb-fe06064a6705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b98bd00-4a41-43d7-a5c6-ff4644582d13", "tag": "2946f3bb-8068-403a-8fc7-8e8c09e8d7c8"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:50.649547 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c933c3d4-ece6-4dee-8d8d-5bcdc6c0a9d7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054114 Aug 03 12:15:50.650488 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 304/582] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 3 12:15:50 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:50.654521 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-77a9d7df-83ad-4d71-87cf-a253de1ff8da req-7ba09159-d87b-4ccb-9ffb-fe06064a6705 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:50.654963 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-77a9d7df-83ad-4d71-87cf-a253de1ff8da req-7ba09159-d87b-4ccb-9ffb-fe06064a6705 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:50.667760 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-77a9d7df-83ad-4d71-87cf-a253de1ff8da req-7ba09159-d87b-4ccb-9ffb-fe06064a6705 service nova] Creating event network-changed:2946f3bb-8068-403a-8fc7-8e8c09e8d7c8 for instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 on hv-cinder-83602 Aug 03 12:15:50.672922 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-77a9d7df-83ad-4d71-87cf-a253de1ff8da req-7ba09159-d87b-4ccb-9ffb-fe06064a6705 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039314 Aug 03 12:15:50.673855 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 279/583] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:15:50.726132 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c8ec50c6-5c5b-4fc1-9210-8a83fe7532cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:50.727863 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c8ec50c6-5c5b-4fc1-9210-8a83fe7532cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:50.734561 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c8ec50c6-5c5b-4fc1-9210-8a83fe7532cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:50.734910 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c8ec50c6-5c5b-4fc1-9210-8a83fe7532cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:50.735700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c8ec50c6-5c5b-4fc1-9210-8a83fe7532cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:50.736136 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c8ec50c6-5c5b-4fc1-9210-8a83fe7532cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:50.766290 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c8ec50c6-5c5b-4fc1-9210-8a83fe7532cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:15:50.858012 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c8ec50c6-5c5b-4fc1-9210-8a83fe7532cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 204 len: 0 microversion: 2.20 time: 0.137058 Aug 03 12:15:50.858671 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 305/584] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Aug 3 12:15:50 2022] DELETE /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 12:15:50.869895 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-8049e21e-361a-47f4-baac-f05686177da0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:50.870919 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-8049e21e-361a-47f4-baac-f05686177da0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:50.878956 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8049e21e-361a-47f4-baac-f05686177da0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:50.879558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8049e21e-361a-47f4-baac-f05686177da0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:50.880698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8049e21e-361a-47f4-baac-f05686177da0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:50.881062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8049e21e-361a-47f4-baac-f05686177da0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:51.028668 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-8049e21e-361a-47f4-baac-f05686177da0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:51.045118 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-8049e21e-361a-47f4-baac-f05686177da0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:51.048193 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-8049e21e-361a-47f4-baac-f05686177da0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:51.050424 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-8049e21e-361a-47f4-baac-f05686177da0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1723 microversion: 2.20 time: 0.186011 Aug 03 12:15:51.051511 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 280/585] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:15:50 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:15:51.473060 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7d0b8c78-7548-411d-8316-4b1cdecf5f27 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:51.473681 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7d0b8c78-7548-411d-8316-4b1cdecf5f27 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:51.481416 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7d0b8c78-7548-411d-8316-4b1cdecf5f27 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:51.481875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7d0b8c78-7548-411d-8316-4b1cdecf5f27 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:51.482697 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7d0b8c78-7548-411d-8316-4b1cdecf5f27 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:51.483140 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7d0b8c78-7548-411d-8316-4b1cdecf5f27 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:51.627969 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7d0b8c78-7548-411d-8316-4b1cdecf5f27 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:51.636662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7d0b8c78-7548-411d-8316-4b1cdecf5f27 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1675 microversion: 2.1 time: 0.168268 Aug 03 12:15:51.637248 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 306/586] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:51 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:52.089676 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a892881c-0c2e-4af0-b106-e87fa7236931 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:52.090393 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a892881c-0c2e-4af0-b106-e87fa7236931 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:52.100808 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a892881c-0c2e-4af0-b106-e87fa7236931 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:52.101293 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a892881c-0c2e-4af0-b106-e87fa7236931 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:52.102101 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a892881c-0c2e-4af0-b106-e87fa7236931 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:52.102575 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a892881c-0c2e-4af0-b106-e87fa7236931 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:52.316726 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a892881c-0c2e-4af0-b106-e87fa7236931 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:52.326639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a892881c-0c2e-4af0-b106-e87fa7236931 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:52.328623 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a892881c-0c2e-4af0-b106-e87fa7236931 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:52.330134 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a892881c-0c2e-4af0-b106-e87fa7236931 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1723 microversion: 2.20 time: 0.244539 Aug 03 12:15:52.330769 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 281/587] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:15:52 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:15:52.661175 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-085c1f8d-8cee-403c-808e-bfb7d6f765bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:52.661970 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-085c1f8d-8cee-403c-808e-bfb7d6f765bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:52.670794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-085c1f8d-8cee-403c-808e-bfb7d6f765bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:52.671252 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-085c1f8d-8cee-403c-808e-bfb7d6f765bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:52.672053 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-085c1f8d-8cee-403c-808e-bfb7d6f765bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:52.672492 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-085c1f8d-8cee-403c-808e-bfb7d6f765bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:53.064667 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-085c1f8d-8cee-403c-808e-bfb7d6f765bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:53.073975 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-085c1f8d-8cee-403c-808e-bfb7d6f765bb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1675 microversion: 2.1 time: 0.418938 Aug 03 12:15:53.086738 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 307/588] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:52 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1675 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:53.355753 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-9e51567f-30ab-4150-988d-48d95cfa9ada tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:53.356779 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-9e51567f-30ab-4150-988d-48d95cfa9ada tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:53.364100 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9e51567f-30ab-4150-988d-48d95cfa9ada tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:53.364556 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9e51567f-30ab-4150-988d-48d95cfa9ada tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:53.365348 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9e51567f-30ab-4150-988d-48d95cfa9ada tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:53.366338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9e51567f-30ab-4150-988d-48d95cfa9ada tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:53.681304 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-9e51567f-30ab-4150-988d-48d95cfa9ada tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:53.689765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-9e51567f-30ab-4150-988d-48d95cfa9ada tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:53.691342 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-9e51567f-30ab-4150-988d-48d95cfa9ada tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:53.692541 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-9e51567f-30ab-4150-988d-48d95cfa9ada tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1723 microversion: 2.20 time: 0.341431 Aug 03 12:15:53.693110 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 282/589] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:15:53 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:15:54.096309 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a051fd62-9202-4cb8-b2e9-9630f1a8c063 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:54.096965 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a051fd62-9202-4cb8-b2e9-9630f1a8c063 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:54.104380 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a051fd62-9202-4cb8-b2e9-9630f1a8c063 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:54.104836 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a051fd62-9202-4cb8-b2e9-9630f1a8c063 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:54.105617 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a051fd62-9202-4cb8-b2e9-9630f1a8c063 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:54.106060 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a051fd62-9202-4cb8-b2e9-9630f1a8c063 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:54.239016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-1779a8bd-2ae3-457a-96c3-06ea67343c9c req-bdff9c74-974f-4a52-9578-f7c60155e4dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afb38cd-ec9c-4509-b7c8-91b170684ec5", "name": "network-vif-deleted", "tag": "8f2969cf-b117-4fef-a2f6-5587992eefda"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:54.271869 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-1779a8bd-2ae3-457a-96c3-06ea67343c9c req-bdff9c74-974f-4a52-9578-f7c60155e4dc service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:54.273196 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-1779a8bd-2ae3-457a-96c3-06ea67343c9c req-bdff9c74-974f-4a52-9578-f7c60155e4dc service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:54.291049 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-1779a8bd-2ae3-457a-96c3-06ea67343c9c req-bdff9c74-974f-4a52-9578-f7c60155e4dc service nova] Creating event network-vif-deleted:8f2969cf-b117-4fef-a2f6-5587992eefda for instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 on hv-cinder-83602 Aug 03 12:15:54.298398 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-1779a8bd-2ae3-457a-96c3-06ea67343c9c req-bdff9c74-974f-4a52-9578-f7c60155e4dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080647 Aug 03 12:15:54.302414 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 283/590] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:15:54.358731 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a051fd62-9202-4cb8-b2e9-9630f1a8c063 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:54.368492 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a051fd62-9202-4cb8-b2e9-9630f1a8c063 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1652 microversion: 2.1 time: 0.276159 Aug 03 12:15:54.369469 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 308/591] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:54 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1652 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:54.392806 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6553e065-8e3e-4ce1-824c-3a44d5de8ae6 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:54.402418 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6553e065-8e3e-4ce1-824c-3a44d5de8ae6 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:54.403846 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6553e065-8e3e-4ce1-824c-3a44d5de8ae6 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:54.483684 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-6553e065-8e3e-4ce1-824c-3a44d5de8ae6 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Going to try to start instance {{(pid=117911) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 12:15:54.540638 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6553e065-8e3e-4ce1-824c-3a44d5de8ae6 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "POST /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/action" status: 202 len: 0 microversion: 2.1 time: 0.152398 Aug 03 12:15:54.541654 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 284/592] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:15:54 2022] POST /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:15:54.551779 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9bb22cd7-e010-4e47-8c6b-7926bce653f8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:54.552407 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9bb22cd7-e010-4e47-8c6b-7926bce653f8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:54.559540 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9bb22cd7-e010-4e47-8c6b-7926bce653f8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:54.559999 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9bb22cd7-e010-4e47-8c6b-7926bce653f8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:54.560816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9bb22cd7-e010-4e47-8c6b-7926bce653f8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:54.561259 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9bb22cd7-e010-4e47-8c6b-7926bce653f8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:54.724721 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-dcaa502c-d37c-4d0c-8452-7593b082488b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:54.729827 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-dcaa502c-d37c-4d0c-8452-7593b082488b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:54.761178 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcaa502c-d37c-4d0c-8452-7593b082488b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:54.766111 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcaa502c-d37c-4d0c-8452-7593b082488b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:54.768728 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcaa502c-d37c-4d0c-8452-7593b082488b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:54.770337 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcaa502c-d37c-4d0c-8452-7593b082488b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:54.787826 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9bb22cd7-e010-4e47-8c6b-7926bce653f8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:54.807148 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9bb22cd7-e010-4e47-8c6b-7926bce653f8 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1661 microversion: 2.1 time: 0.259123 Aug 03 12:15:54.808900 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 309/593] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:54 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1661 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:54.841901 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcaa502c-d37c-4d0c-8452-7593b082488b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:54.842405 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dcaa502c-d37c-4d0c-8452-7593b082488b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:54.843024 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-dcaa502c-d37c-4d0c-8452-7593b082488b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lazy-loading 'fault' on Instance uuid 4afb38cd-ec9c-4509-b7c8-91b170684ec5 {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:15:54.981525 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dcaa502c-d37c-4d0c-8452-7593b082488b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:54.989975 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dcaa502c-d37c-4d0c-8452-7593b082488b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:54.992305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dcaa502c-d37c-4d0c-8452-7593b082488b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:54.993493 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-dcaa502c-d37c-4d0c-8452-7593b082488b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 200 len: 1372 microversion: 2.20 time: 0.279683 Aug 03 12:15:54.994082 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 285/594] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:15:54 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 1372 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:15:55.837243 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a7a7c8ea-3457-4c1b-891e-ccd3541cd5fb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:55.837844 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a7a7c8ea-3457-4c1b-891e-ccd3541cd5fb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:55.844881 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a7a7c8ea-3457-4c1b-891e-ccd3541cd5fb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:55.845336 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a7a7c8ea-3457-4c1b-891e-ccd3541cd5fb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:55.846125 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a7a7c8ea-3457-4c1b-891e-ccd3541cd5fb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:55.846592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a7a7c8ea-3457-4c1b-891e-ccd3541cd5fb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:56.016840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3da1a5cd-a5d2-4984-976e-7b403347538c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:56.017586 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-3da1a5cd-a5d2-4984-976e-7b403347538c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:56.025387 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3da1a5cd-a5d2-4984-976e-7b403347538c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:56.025838 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3da1a5cd-a5d2-4984-976e-7b403347538c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:56.026788 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3da1a5cd-a5d2-4984-976e-7b403347538c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:56.027237 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3da1a5cd-a5d2-4984-976e-7b403347538c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:56.041791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-3da1a5cd-a5d2-4984-976e-7b403347538c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] HTTP exception thrown: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3da1a5cd-a5d2-4984-976e-7b403347538c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Request method failure captured: Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 HTTP/1.1 Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXh0wloqivlKTpkBNiD0FOFLHIZyXKcsZJzySbmGUQ8hR0gGh-XabyEUGCVut0Zb-W6k661_ZfaqEplP8kTCnHA_8nHG5jPZLbAMEc3OTpbfsxSl2i4g-BhfL6yvp4_v5urKFqVSmi8FAxxna_hrjVzNov-Ncvie3wjoHzkqKGZorA Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: fbbed7fab4584f379dbefe4af9826544 Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:15:56.043618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:15:56.045258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fbbed7fab4584f379dbefe4af9826544", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:15:56.045258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:15:56.045258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: fbbed7fab4584f379dbefe4af9826544 Aug 03 12:15:56.045258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:15:56.045258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-AttachVolumeShelveTestJSON-1781968059-project Aug 03 12:15:56.045258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:15:56.045258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:15:56.045258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 42ce2627c0f142f8892c182f69ef9a39 Aug 03 12:15:56.045258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781968059-project Aug 03 12:15:56.045258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:15:56.045258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:15:56.045258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': '4afb38cd-ec9c-4509-b7c8-91b170684ec5'} Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:15:56.046350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:15:56.048652 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:15:56.050899 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3da1a5cd-a5d2-4984-976e-7b403347538c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Returning 404 to user: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:15:56.050899 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-3da1a5cd-a5d2-4984-976e-7b403347538c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 404 len: 111 microversion: 2.20 time: 0.032677 Aug 03 12:15:56.050899 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 286/595] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:15:56 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 12:15:56.054646 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5914d590-1d2c-45ac-bf49-8eb1716c29c5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '.version_select at 0x7f14d6f8f670>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:56.062691 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a7a7c8ea-3457-4c1b-891e-ccd3541cd5fb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:56.072304 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a7a7c8ea-3457-4c1b-891e-ccd3541cd5fb tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1661 microversion: 2.1 time: 0.239680 Aug 03 12:15:56.085613 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 310/596] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:55 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1661 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:56.085957 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5914d590-1d2c-45ac-bf49-8eb1716c29c5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388041272" status: 204 len: 0 microversion: 2.20 time: 0.028697 Aug 03 12:15:56.085957 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 287/597] 10.222.0.17 () {60 vars in 1262 bytes} [Wed Aug 3 12:15:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388041272 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 03 12:15:56.911965 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-afb29a29-cb80-4bb9-bb6d-65bd002f71cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Action: 'create', calling method: .version_select at 0x7f14dc089dc0>, body: {"keypair": {"name": "tempest-keypair-956143823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4nT2hz+9qVr4nO412KV6jYfUcTU90BCKhOBmhvAqrh5Bz0jVIJDXwYQWwKm57IlbVYfJ/hU1Muo4+a9xhUUrtrDNioGnDubst1aSmMh3vgQ3wBCuBrSERtib/C3rZOXA=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:56.936810 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-afb29a29-cb80-4bb9-bb6d-65bd002f71cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Getting quotas for project fbbed7fab4584f379dbefe4af9826544. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:15:56.944538 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-afb29a29-cb80-4bb9-bb6d-65bd002f71cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Getting quotas for user 42ce2627c0f142f8892c182f69ef9a39 and project fbbed7fab4584f379dbefe4af9826544. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:15:56.979956 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-afb29a29-cb80-4bb9-bb6d-65bd002f71cc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.071805 Aug 03 12:15:56.980824 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 311/598] 10.222.0.17 () {62 vars in 1200 bytes} [Wed Aug 3 12:15:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 12:15:57.113655 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d73d8027-eb29-4716-baac-041348b06bed tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:57.114826 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d73d8027-eb29-4716-baac-041348b06bed tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:57.128892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d73d8027-eb29-4716-baac-041348b06bed tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:57.130087 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d73d8027-eb29-4716-baac-041348b06bed tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:57.132163 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d73d8027-eb29-4716-baac-041348b06bed tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:57.133235 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d73d8027-eb29-4716-baac-041348b06bed tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:57.392323 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d73d8027-eb29-4716-baac-041348b06bed tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:57.401127 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d73d8027-eb29-4716-baac-041348b06bed tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1665 microversion: 2.1 time: 0.297266 Aug 03 12:15:57.414077 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 288/599] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:15:57 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1665 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:15:58.380052 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1372720294", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d3355728-01c2-4642-be6b-47d847609cf2"}], "security_groups": [{"name": "tempest-securitygroup--420086081"}], "key_name": "tempest-keypair-956143823", "user_data": "}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:15:58.500272 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] validate_networks() for [('d3355728-01c2-4642-be6b-47d847609cf2', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:15:58.948616 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:15:58.949081 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:15:58.949602 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:15:58.950019 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:15:58.950434 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:15:58.965659 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:58.966505 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:58.967975 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:15:58.968779 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:15:59.001114 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Getting quotas for project fbbed7fab4584f379dbefe4af9826544. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:15:59.009814 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Getting quotas for user 42ce2627c0f142f8892c182f69ef9a39 and project fbbed7fab4584f379dbefe4af9826544. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:15:59.031351 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:15:59.036147 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:15:59.124165 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1f7ee061-8627-41d3-817c-fdf2da4c8c31 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.749774 Aug 03 12:15:59.125075 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 312/600] 10.222.0.17 () {62 vars in 1188 bytes} [Wed Aug 3 12:15:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 12:15:59.137755 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f67fbbac-58e3-4d82-9c53-b18131191406 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:15:59.138551 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f67fbbac-58e3-4d82-9c53-b18131191406 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:15:59.277856 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f67fbbac-58e3-4d82-9c53-b18131191406 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:59.289302 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f67fbbac-58e3-4d82-9c53-b18131191406 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:59.290926 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f67fbbac-58e3-4d82-9c53-b18131191406 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:15:59.292452 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f67fbbac-58e3-4d82-9c53-b18131191406 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1281 microversion: 2.20 time: 0.159405 Aug 03 12:15:59.293525 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 289/601] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:15:59 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1281 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:16:00.317243 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-960389c8-dbc0-4d37-a78d-12e07b75e975 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:00.318070 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-960389c8-dbc0-4d37-a78d-12e07b75e975 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:00.327365 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-960389c8-dbc0-4d37-a78d-12e07b75e975 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:00.327812 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-960389c8-dbc0-4d37-a78d-12e07b75e975 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:00.328843 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-960389c8-dbc0-4d37-a78d-12e07b75e975 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:00.329275 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-960389c8-dbc0-4d37-a78d-12e07b75e975 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:00.408232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-960389c8-dbc0-4d37-a78d-12e07b75e975 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:00.428934 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-960389c8-dbc0-4d37-a78d-12e07b75e975 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:00.432995 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-960389c8-dbc0-4d37-a78d-12e07b75e975 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:00.435472 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-960389c8-dbc0-4d37-a78d-12e07b75e975 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1351 microversion: 2.20 time: 0.123300 Aug 03 12:16:00.437129 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 313/602] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:16:00 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:16:01.460100 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3ff5200c-9f97-4f4f-9f86-fab195e292b3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:01.461036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-3ff5200c-9f97-4f4f-9f86-fab195e292b3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:01.469327 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3ff5200c-9f97-4f4f-9f86-fab195e292b3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:01.469778 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3ff5200c-9f97-4f4f-9f86-fab195e292b3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:01.470635 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3ff5200c-9f97-4f4f-9f86-fab195e292b3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:01.471182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3ff5200c-9f97-4f4f-9f86-fab195e292b3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:01.687469 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-3ff5200c-9f97-4f4f-9f86-fab195e292b3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:01.697370 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-3ff5200c-9f97-4f4f-9f86-fab195e292b3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:01.698549 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-3ff5200c-9f97-4f4f-9f86-fab195e292b3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:01.699626 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-3ff5200c-9f97-4f4f-9f86-fab195e292b3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1406 microversion: 2.20 time: 0.244351 Aug 03 12:16:01.700384 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 290/603] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:16:01 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:16:01.950712 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-52dba799-5891-430d-818e-a39ffe4cd62b req-4413311e-576d-41ca-b15f-cfc2499f7e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5335f69-42aa-4fcf-8ee9-223f8e1485ec", "tag": "02cf3d48-0345-435e-ba69-48f06b2d3b86"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:01.965127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-52dba799-5891-430d-818e-a39ffe4cd62b req-4413311e-576d-41ca-b15f-cfc2499f7e56 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:01.965583 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-52dba799-5891-430d-818e-a39ffe4cd62b req-4413311e-576d-41ca-b15f-cfc2499f7e56 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:01.979528 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-52dba799-5891-430d-818e-a39ffe4cd62b req-4413311e-576d-41ca-b15f-cfc2499f7e56 service nova] Creating event network-changed:02cf3d48-0345-435e-ba69-48f06b2d3b86 for instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec on hv-cinder-83602 Aug 03 12:16:01.984824 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-52dba799-5891-430d-818e-a39ffe4cd62b req-4413311e-576d-41ca-b15f-cfc2499f7e56 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038755 Aug 03 12:16:01.985874 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 314/604] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:02.723294 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1955db3b-6dfe-453b-a542-bf3a04f7ddf8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:02.723825 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1955db3b-6dfe-453b-a542-bf3a04f7ddf8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:02.731209 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1955db3b-6dfe-453b-a542-bf3a04f7ddf8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:02.731658 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1955db3b-6dfe-453b-a542-bf3a04f7ddf8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:02.732455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1955db3b-6dfe-453b-a542-bf3a04f7ddf8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:02.733002 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1955db3b-6dfe-453b-a542-bf3a04f7ddf8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:02.877918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1955db3b-6dfe-453b-a542-bf3a04f7ddf8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:02.886884 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1955db3b-6dfe-453b-a542-bf3a04f7ddf8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:02.888377 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1955db3b-6dfe-453b-a542-bf3a04f7ddf8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:02.889480 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1955db3b-6dfe-453b-a542-bf3a04f7ddf8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1406 microversion: 2.20 time: 0.170307 Aug 03 12:16:02.890037 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 291/605] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:16:02 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:16:03.914279 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a5e27571-a5eb-49cc-afbd-e9e320b211c8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:03.915223 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a5e27571-a5eb-49cc-afbd-e9e320b211c8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:03.923245 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a5e27571-a5eb-49cc-afbd-e9e320b211c8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:03.923845 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a5e27571-a5eb-49cc-afbd-e9e320b211c8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:03.924723 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a5e27571-a5eb-49cc-afbd-e9e320b211c8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:03.925308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a5e27571-a5eb-49cc-afbd-e9e320b211c8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:04.091093 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a5e27571-a5eb-49cc-afbd-e9e320b211c8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:04.099918 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a5e27571-a5eb-49cc-afbd-e9e320b211c8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:04.101820 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a5e27571-a5eb-49cc-afbd-e9e320b211c8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:04.103105 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a5e27571-a5eb-49cc-afbd-e9e320b211c8 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1406 microversion: 2.20 time: 0.194212 Aug 03 12:16:04.103779 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 315/606] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:16:03 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:16:05.127683 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b99e96ea-e757-4278-9034-3a1d6118f325 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:05.128436 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b99e96ea-e757-4278-9034-3a1d6118f325 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:05.135765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b99e96ea-e757-4278-9034-3a1d6118f325 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:05.136354 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b99e96ea-e757-4278-9034-3a1d6118f325 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:05.137266 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b99e96ea-e757-4278-9034-3a1d6118f325 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:05.137841 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b99e96ea-e757-4278-9034-3a1d6118f325 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:05.294130 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b99e96ea-e757-4278-9034-3a1d6118f325 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:05.304891 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b99e96ea-e757-4278-9034-3a1d6118f325 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:05.306375 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b99e96ea-e757-4278-9034-3a1d6118f325 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:05.307619 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b99e96ea-e757-4278-9034-3a1d6118f325 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1406 microversion: 2.20 time: 0.183984 Aug 03 12:16:05.308175 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 292/607] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:16:05 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:16:06.338018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b0974655-f7b1-47f4-8e30-c7d71f4a9802 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:06.339122 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b0974655-f7b1-47f4-8e30-c7d71f4a9802 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:06.350998 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b0974655-f7b1-47f4-8e30-c7d71f4a9802 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:06.351443 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b0974655-f7b1-47f4-8e30-c7d71f4a9802 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:06.352236 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b0974655-f7b1-47f4-8e30-c7d71f4a9802 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:06.352668 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b0974655-f7b1-47f4-8e30-c7d71f4a9802 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:06.507672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b0974655-f7b1-47f4-8e30-c7d71f4a9802 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:06.516328 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b0974655-f7b1-47f4-8e30-c7d71f4a9802 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:06.517833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b0974655-f7b1-47f4-8e30-c7d71f4a9802 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:06.519286 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b0974655-f7b1-47f4-8e30-c7d71f4a9802 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1406 microversion: 2.20 time: 0.190660 Aug 03 12:16:06.519865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 316/608] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:16:06 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:16:07.553043 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-94de624e-8664-4ab8-93b7-e8bc549159f3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:07.553664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-94de624e-8664-4ab8-93b7-e8bc549159f3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:07.560278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-94de624e-8664-4ab8-93b7-e8bc549159f3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:07.560715 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-94de624e-8664-4ab8-93b7-e8bc549159f3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:07.561481 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-94de624e-8664-4ab8-93b7-e8bc549159f3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:07.561909 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-94de624e-8664-4ab8-93b7-e8bc549159f3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:07.695938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-94de624e-8664-4ab8-93b7-e8bc549159f3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:07.704361 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-94de624e-8664-4ab8-93b7-e8bc549159f3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:07.705877 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-94de624e-8664-4ab8-93b7-e8bc549159f3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:07.707032 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-94de624e-8664-4ab8-93b7-e8bc549159f3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1406 microversion: 2.20 time: 0.158010 Aug 03 12:16:07.707586 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 293/609] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:16:07 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:16:08.089995 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-d2cb4f14-f8e4-43df-b32c-8a1507a8f0bd req-16965842-7b87-483b-b5e1-93abb6a0d48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5335f69-42aa-4fcf-8ee9-223f8e1485ec", "name": "network-vif-plugged", "status": "completed", "tag": "02cf3d48-0345-435e-ba69-48f06b2d3b86"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:08.095517 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:08.101028 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-d2cb4f14-f8e4-43df-b32c-8a1507a8f0bd req-16965842-7b87-483b-b5e1-93abb6a0d48e service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:08.101484 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-d2cb4f14-f8e4-43df-b32c-8a1507a8f0bd req-16965842-7b87-483b-b5e1-93abb6a0d48e service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:08.113713 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-d2cb4f14-f8e4-43df-b32c-8a1507a8f0bd req-16965842-7b87-483b-b5e1-93abb6a0d48e service nova] Creating event network-vif-plugged:02cf3d48-0345-435e-ba69-48f06b2d3b86 for instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec on hv-cinder-83602 Aug 03 12:16:08.119224 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-d2cb4f14-f8e4-43df-b32c-8a1507a8f0bd req-16965842-7b87-483b-b5e1-93abb6a0d48e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032923 Aug 03 12:16:08.119833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 317/610] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:08.730098 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b2282809-c698-466a-8ece-0809d0752cb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:08.730696 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b2282809-c698-466a-8ece-0809d0752cb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:08.737351 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b2282809-c698-466a-8ece-0809d0752cb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:08.737793 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b2282809-c698-466a-8ece-0809d0752cb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:08.738612 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b2282809-c698-466a-8ece-0809d0752cb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:08.739055 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b2282809-c698-466a-8ece-0809d0752cb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:08.881383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b2282809-c698-466a-8ece-0809d0752cb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:08.891148 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b2282809-c698-466a-8ece-0809d0752cb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:08.892433 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b2282809-c698-466a-8ece-0809d0752cb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:08.893587 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b2282809-c698-466a-8ece-0809d0752cb5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1406 microversion: 2.20 time: 0.167655 Aug 03 12:16:08.894425 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 294/611] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:16:08 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:16:09.914673 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:09.915426 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=10 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:09.920630 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9524901e-bf56-4e33-b279-6825effc4bb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:09.921331 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9524901e-bf56-4e33-b279-6825effc4bb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:09.929272 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9524901e-bf56-4e33-b279-6825effc4bb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:09.929724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9524901e-bf56-4e33-b279-6825effc4bb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:09.930522 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9524901e-bf56-4e33-b279-6825effc4bb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:09.930963 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9524901e-bf56-4e33-b279-6825effc4bb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:10.070276 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9524901e-bf56-4e33-b279-6825effc4bb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:10.072573 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:10.079795 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9524901e-bf56-4e33-b279-6825effc4bb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:10.081319 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9524901e-bf56-4e33-b279-6825effc4bb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:10.082524 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9524901e-bf56-4e33-b279-6825effc4bb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1599 microversion: 2.20 time: 0.168839 Aug 03 12:16:10.083089 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 318/612] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:16:09 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:16:10.112510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-fca0e4bd-9bdb-4693-bb79-a4233f6419cb tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:10.113459 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-fca0e4bd-9bdb-4693-bb79-a4233f6419cb tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:10.117488 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:10.127653 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fca0e4bd-9bdb-4693-bb79-a4233f6419cb tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:10.128452 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fca0e4bd-9bdb-4693-bb79-a4233f6419cb tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:10.129858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fca0e4bd-9bdb-4693-bb79-a4233f6419cb tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:10.130698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fca0e4bd-9bdb-4693-bb79-a4233f6419cb tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:10.245400 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-fca0e4bd-9bdb-4693-bb79-a4233f6419cb tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.140251 Aug 03 12:16:10.246024 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 295/613] 10.222.0.17 () {60 vars in 1316 bytes} [Wed Aug 3 12:16:10 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:16:11.488486 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-19bb0ca7-f45d-4d24-86ec-fc7a72837d49 req-f805b53c-c99b-4afb-9b24-ae15464715f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5335f69-42aa-4fcf-8ee9-223f8e1485ec", "tag": "02cf3d48-0345-435e-ba69-48f06b2d3b86"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:11.499810 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-19bb0ca7-f45d-4d24-86ec-fc7a72837d49 req-f805b53c-c99b-4afb-9b24-ae15464715f8 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:11.500247 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-19bb0ca7-f45d-4d24-86ec-fc7a72837d49 req-f805b53c-c99b-4afb-9b24-ae15464715f8 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:11.514426 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-19bb0ca7-f45d-4d24-86ec-fc7a72837d49 req-f805b53c-c99b-4afb-9b24-ae15464715f8 service nova] Creating event network-changed:02cf3d48-0345-435e-ba69-48f06b2d3b86 for instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec on hv-cinder-83602 Aug 03 12:16:11.519972 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-19bb0ca7-f45d-4d24-86ec-fc7a72837d49 req-f805b53c-c99b-4afb-9b24-ae15464715f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035309 Aug 03 12:16:11.520591 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 319/614] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:16.189235 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-45cae096-470e-40b1-9c83-f5d44377ad43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:16.189930 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-45cae096-470e-40b1-9c83-f5d44377ad43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:16.191933 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:16.199123 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-45cae096-470e-40b1-9c83-f5d44377ad43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:16.199561 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-45cae096-470e-40b1-9c83-f5d44377ad43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:16.200351 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-45cae096-470e-40b1-9c83-f5d44377ad43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:16.200799 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-45cae096-470e-40b1-9c83-f5d44377ad43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:16.222358 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:16.228766 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-45cae096-470e-40b1-9c83-f5d44377ad43 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/ips" status: 200 len: 150 microversion: 2.1 time: 0.111611 Aug 03 12:16:16.229342 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 296/615] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 3 12:16:16 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/ips => generated 150 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:17.657479 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7473a048-3ea4-4994-897f-14be9bd33856 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c07a1b66-0e9d-42e6-b4ba-1340a72acd90"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:17.661937 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7473a048-3ea4-4994-897f-14be9bd33856 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:17.674235 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7473a048-3ea4-4994-897f-14be9bd33856 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:17.675061 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7473a048-3ea4-4994-897f-14be9bd33856 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:17.676299 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7473a048-3ea4-4994-897f-14be9bd33856 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:17.677114 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-7473a048-3ea4-4994-897f-14be9bd33856 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:17.979259 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7473a048-3ea4-4994-897f-14be9bd33856 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "POST /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329465 Aug 03 12:16:17.980094 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 320/616] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:16:17 2022] POST /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:25.633293 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-85ed8a4e-5133-4df2-be13-0d7635bce389 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c07a1b66-0e9d-42e6-b4ba-1340a72acd90"}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:25.637639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-85ed8a4e-5133-4df2-be13-0d7635bce389 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:25.649536 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-85ed8a4e-5133-4df2-be13-0d7635bce389 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:25.650051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-85ed8a4e-5133-4df2-be13-0d7635bce389 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:25.650967 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-85ed8a4e-5133-4df2-be13-0d7635bce389 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:25.651412 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-85ed8a4e-5133-4df2-be13-0d7635bce389 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:25.745225 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-85ed8a4e-5133-4df2-be13-0d7635bce389 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Invalid volume: volume c07a1b66-0e9d-42e6-b4ba-1340a72acd90 is already attached to instances: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-85ed8a4e-5133-4df2-be13-0d7635bce389 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: POST /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-volume_attachments HTTP/1.1 Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 74 Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:16:25.747287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:16:25.749211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:16:25.749211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:16:25.749211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:16:25.749211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:16:25.749211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:16:25.749211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:16:25.749211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:16:25.749211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:16:25.749211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:16:25.749211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Aug 03 12:16:25.749211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {"volumeAttachment": {"volumeId": "c07a1b66-0e9d-42e6-b4ba-1340a72acd90"}} Aug 03 12:16:25.749211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Invalid volume: volume c07a1b66-0e9d-42e6-b4ba-1340a72acd90 is already attached to instances: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'server_id': 'afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a', 'body': {'volumeAttachment': {'volumeId': 'c07a1b66-0e9d-42e6-b4ba-1340a72acd90'}}} Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c07a1b66-0e9d-42e6-b4ba-1340a72acd90 is already attached to instances: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:25.749938 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c07a1b66-0e9d-42e6-b4ba-1340a72acd90 is already attached to instances: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:25.751368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:25.752523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:25.752523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:16:25.752523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:16:25.752523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c07a1b66-0e9d-42e6-b4ba-1340a72acd90 is already attached to instances: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a Aug 03 12:16:25.752523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:25.752523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-85ed8a4e-5133-4df2-be13-0d7635bce389 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 400 to user: Invalid volume: volume c07a1b66-0e9d-42e6-b4ba-1340a72acd90 is already attached to instances: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:16:25.752523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-85ed8a4e-5133-4df2-be13-0d7635bce389 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "POST /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.124575 Aug 03 12:16:25.752523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 297/617] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:16:25 2022] POST /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-volume_attachments => generated 174 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 12:16:25.822701 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-34a0a9a7-012f-4013-9674-a0113096eb86 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:25.823501 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-34a0a9a7-012f-4013-9674-a0113096eb86 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:25.832927 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-34a0a9a7-012f-4013-9674-a0113096eb86 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:25.833385 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-34a0a9a7-012f-4013-9674-a0113096eb86 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:25.834219 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-34a0a9a7-012f-4013-9674-a0113096eb86 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:25.834733 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-34a0a9a7-012f-4013-9674-a0113096eb86 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:25.933033 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-34a0a9a7-012f-4013-9674-a0113096eb86 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lazy-loading 'services' on Instance uuid afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:16:26.059853 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-34a0a9a7-012f-4013-9674-a0113096eb86 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-volume_attachments/c07a1b66-0e9d-42e6-b4ba-1340a72acd90" status: 202 len: 0 microversion: 2.1 time: 0.242518 Aug 03 12:16:26.060672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 321/618] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 3 12:16:25 2022] DELETE /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-volume_attachments/c07a1b66-0e9d-42e6-b4ba-1340a72acd90 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:16:26.069432 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3c428980-230b-4a0a-9abc-3fc4a18ce592 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:26.072391 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-3c428980-230b-4a0a-9abc-3fc4a18ce592 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:26.079098 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3c428980-230b-4a0a-9abc-3fc4a18ce592 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:26.079553 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3c428980-230b-4a0a-9abc-3fc4a18ce592 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:26.080329 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3c428980-230b-4a0a-9abc-3fc4a18ce592 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:26.080760 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3c428980-230b-4a0a-9abc-3fc4a18ce592 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:26.124285 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-3c428980-230b-4a0a-9abc-3fc4a18ce592 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058964 Aug 03 12:16:26.124746 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 298/619] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:16:26 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:26.432108 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b5e2793f-9359-476f-bd84-7f251bfc703e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:26.432725 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b5e2793f-9359-476f-bd84-7f251bfc703e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:26.439437 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b5e2793f-9359-476f-bd84-7f251bfc703e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:26.439886 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b5e2793f-9359-476f-bd84-7f251bfc703e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:26.440645 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b5e2793f-9359-476f-bd84-7f251bfc703e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:26.441081 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b5e2793f-9359-476f-bd84-7f251bfc703e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:26.522172 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-b5e2793f-9359-476f-bd84-7f251bfc703e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lazy-loading 'services' on Instance uuid 2b98bd00-4a41-43d7-a5c6-ff4644582d13 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:16:26.594219 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b5e2793f-9359-476f-bd84-7f251bfc703e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-volume_attachments/c97255cd-621a-49f8-b1e9-ac08182dbd96" status: 202 len: 0 microversion: 2.1 time: 0.166252 Aug 03 12:16:26.595021 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 322/620] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 3 12:16:26 2022] DELETE /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-volume_attachments/c97255cd-621a-49f8-b1e9-ac08182dbd96 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:16:26.603305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e43642e0-04ef-4bdf-a262-c6ed40d243bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:26.605487 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e43642e0-04ef-4bdf-a262-c6ed40d243bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:26.612392 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e43642e0-04ef-4bdf-a262-c6ed40d243bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:26.612952 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e43642e0-04ef-4bdf-a262-c6ed40d243bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:26.613931 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e43642e0-04ef-4bdf-a262-c6ed40d243bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:26.614400 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e43642e0-04ef-4bdf-a262-c6ed40d243bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:26.650546 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e43642e0-04ef-4bdf-a262-c6ed40d243bf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051031 Aug 03 12:16:26.651129 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 299/621] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:16:26 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:27.138028 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-71c89c10-6e8d-4a7b-a655-d329882c66e3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:27.140324 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-71c89c10-6e8d-4a7b-a655-d329882c66e3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:27.147624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-71c89c10-6e8d-4a7b-a655-d329882c66e3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:27.148078 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-71c89c10-6e8d-4a7b-a655-d329882c66e3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:27.148855 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-71c89c10-6e8d-4a7b-a655-d329882c66e3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:27.149295 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-71c89c10-6e8d-4a7b-a655-d329882c66e3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:27.180704 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-71c89c10-6e8d-4a7b-a655-d329882c66e3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047013 Aug 03 12:16:27.181290 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 323/622] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:16:27 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:27.663604 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-be2eef2c-ee7f-4909-bf53-69e2382f6951 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:27.665803 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-be2eef2c-ee7f-4909-bf53-69e2382f6951 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:27.672459 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-be2eef2c-ee7f-4909-bf53-69e2382f6951 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:27.672922 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-be2eef2c-ee7f-4909-bf53-69e2382f6951 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:27.673709 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-be2eef2c-ee7f-4909-bf53-69e2382f6951 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:27.674273 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-be2eef2c-ee7f-4909-bf53-69e2382f6951 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:27.704572 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-be2eef2c-ee7f-4909-bf53-69e2382f6951 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 Aug 03 12:16:27.705330 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 300/623] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:16:27 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:28.194184 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-51d7961c-36af-448a-90df-9774824f3527 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:28.196649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-51d7961c-36af-448a-90df-9774824f3527 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:28.203228 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-51d7961c-36af-448a-90df-9774824f3527 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:28.203677 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-51d7961c-36af-448a-90df-9774824f3527 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:28.204427 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-51d7961c-36af-448a-90df-9774824f3527 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:28.204857 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-51d7961c-36af-448a-90df-9774824f3527 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:28.236033 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-51d7961c-36af-448a-90df-9774824f3527 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046715 Aug 03 12:16:28.236610 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 324/624] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:16:28 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 12:16:28.300764 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6e2a2ebd-5ed4-4a67-8fec-ce48b2c4d118 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:28.301265 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-6e2a2ebd-5ed4-4a67-8fec-ce48b2c4d118 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:28.307694 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6e2a2ebd-5ed4-4a67-8fec-ce48b2c4d118 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:28.308136 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6e2a2ebd-5ed4-4a67-8fec-ce48b2c4d118 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:28.308910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6e2a2ebd-5ed4-4a67-8fec-ce48b2c4d118 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:28.309345 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6e2a2ebd-5ed4-4a67-8fec-ce48b2c4d118 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:28.336332 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-6e2a2ebd-5ed4-4a67-8fec-ce48b2c4d118 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Going to try to terminate instance {{(pid=117911) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:16:28.424575 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6e2a2ebd-5ed4-4a67-8fec-ce48b2c4d118 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 204 len: 0 microversion: 2.1 time: 0.127318 Aug 03 12:16:28.425124 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 301/625] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:16:28 2022] DELETE /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:16:28.434381 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-34b0069b-bf94-4e3e-87bb-9aaefa1ada6d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:28.435041 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-34b0069b-bf94-4e3e-87bb-9aaefa1ada6d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:28.441161 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-34b0069b-bf94-4e3e-87bb-9aaefa1ada6d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:28.441607 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-34b0069b-bf94-4e3e-87bb-9aaefa1ada6d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:28.442381 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-34b0069b-bf94-4e3e-87bb-9aaefa1ada6d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:28.442847 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-34b0069b-bf94-4e3e-87bb-9aaefa1ada6d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:28.579449 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-34b0069b-bf94-4e3e-87bb-9aaefa1ada6d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:28.587591 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-34b0069b-bf94-4e3e-87bb-9aaefa1ada6d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1682 microversion: 2.1 time: 0.157049 Aug 03 12:16:28.588173 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 325/626] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:28 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:28.718559 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b4fad14e-a57a-4a1c-838b-4fb97e2bd129 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:28.720752 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b4fad14e-a57a-4a1c-838b-4fb97e2bd129 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:28.728050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b4fad14e-a57a-4a1c-838b-4fb97e2bd129 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:28.728503 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b4fad14e-a57a-4a1c-838b-4fb97e2bd129 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:28.729325 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b4fad14e-a57a-4a1c-838b-4fb97e2bd129 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:28.729769 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b4fad14e-a57a-4a1c-838b-4fb97e2bd129 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:28.760352 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b4fad14e-a57a-4a1c-838b-4fb97e2bd129 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046260 Aug 03 12:16:28.760936 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 302/627] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:16:28 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 12:16:28.841288 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4690caba-932e-4284-bedb-55882347eaa1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:28.841806 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4690caba-932e-4284-bedb-55882347eaa1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:28.848001 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4690caba-932e-4284-bedb-55882347eaa1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:28.848438 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4690caba-932e-4284-bedb-55882347eaa1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:28.849210 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4690caba-932e-4284-bedb-55882347eaa1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:28.849744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4690caba-932e-4284-bedb-55882347eaa1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:28.877316 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4690caba-932e-4284-bedb-55882347eaa1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:16:28.962098 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4690caba-932e-4284-bedb-55882347eaa1 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 204 len: 0 microversion: 2.1 time: 0.124648 Aug 03 12:16:28.962714 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 326/628] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:16:28 2022] DELETE /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:16:28.971755 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-37374291-7228-482b-9add-82421bbcb511 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:28.972349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-37374291-7228-482b-9add-82421bbcb511 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:28.978902 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37374291-7228-482b-9add-82421bbcb511 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:28.979351 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37374291-7228-482b-9add-82421bbcb511 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:28.980115 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37374291-7228-482b-9add-82421bbcb511 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:28.980554 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-37374291-7228-482b-9add-82421bbcb511 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:29.124897 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-37374291-7228-482b-9add-82421bbcb511 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:29.133310 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-37374291-7228-482b-9add-82421bbcb511 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1690 microversion: 2.1 time: 0.166060 Aug 03 12:16:29.133888 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 303/629] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:28 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:29.609866 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-91fc771a-7a95-407b-8e56-c08479e318cd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:29.610607 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-91fc771a-7a95-407b-8e56-c08479e318cd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:29.617860 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-91fc771a-7a95-407b-8e56-c08479e318cd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:29.618311 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-91fc771a-7a95-407b-8e56-c08479e318cd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:29.619119 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-91fc771a-7a95-407b-8e56-c08479e318cd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:29.619554 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-91fc771a-7a95-407b-8e56-c08479e318cd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:29.760571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-91fc771a-7a95-407b-8e56-c08479e318cd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:29.768092 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-91fc771a-7a95-407b-8e56-c08479e318cd tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1682 microversion: 2.1 time: 0.162414 Aug 03 12:16:29.768681 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 327/630] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:29 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:29.896878 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-bb8caa3a-aa76-43fc-8c5b-0fd62c4cb5a4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-880212409"}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:29.897554 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-bb8caa3a-aa76-43fc-8c5b-0fd62c4cb5a4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:29.905539 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bb8caa3a-aa76-43fc-8c5b-0fd62c4cb5a4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:29.906006 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bb8caa3a-aa76-43fc-8c5b-0fd62c4cb5a4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:29.906800 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bb8caa3a-aa76-43fc-8c5b-0fd62c4cb5a4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:29.907237 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bb8caa3a-aa76-43fc-8c5b-0fd62c4cb5a4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:30.061525 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.network.security_group_api [None req-bb8caa3a-aa76-43fc-8c5b-0fd62c4cb5a4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Removing security group b22bf39c-286a-4d7b-82a8-7564288dea1b from port c2052327-4535-436a-9914-53604665eddd Aug 03 12:16:30.166068 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d4d0375d-c84f-434f-b4ff-a114de7cc54e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:30.166699 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d4d0375d-c84f-434f-b4ff-a114de7cc54e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:30.176894 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d4d0375d-c84f-434f-b4ff-a114de7cc54e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:30.177344 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d4d0375d-c84f-434f-b4ff-a114de7cc54e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:30.178129 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d4d0375d-c84f-434f-b4ff-a114de7cc54e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:30.178607 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d4d0375d-c84f-434f-b4ff-a114de7cc54e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:30.327077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d4d0375d-c84f-434f-b4ff-a114de7cc54e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:30.336290 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d4d0375d-c84f-434f-b4ff-a114de7cc54e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1690 microversion: 2.1 time: 0.174627 Aug 03 12:16:30.336883 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 328/631] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:30 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:16:30.409473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-bb8caa3a-aa76-43fc-8c5b-0fd62c4cb5a4 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "POST /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/action" status: 202 len: 0 microversion: 2.1 time: 0.517729 Aug 03 12:16:30.410530 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 304/632] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:16:29 2022] POST /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 12:16:30.420659 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-167590f8-9b85-4908-8c23-f1adb7857fef req-463b24be-3b7a-4ad0-a4e9-d683f5a6bca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ef0b56c-b712-49ca-8847-a0acbc0a729a", "tag": "c2052327-4535-436a-9914-53604665eddd"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:30.441168 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-167590f8-9b85-4908-8c23-f1adb7857fef req-463b24be-3b7a-4ad0-a4e9-d683f5a6bca9 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:30.441819 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-167590f8-9b85-4908-8c23-f1adb7857fef req-463b24be-3b7a-4ad0-a4e9-d683f5a6bca9 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:30.457575 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-167590f8-9b85-4908-8c23-f1adb7857fef req-463b24be-3b7a-4ad0-a4e9-d683f5a6bca9 service nova] Creating event network-changed:c2052327-4535-436a-9914-53604665eddd for instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a on hv-cinder-83602 Aug 03 12:16:30.465125 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-167590f8-9b85-4908-8c23-f1adb7857fef req-463b24be-3b7a-4ad0-a4e9-d683f5a6bca9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048382 Aug 03 12:16:30.466046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 329/633] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:30.789821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4843f595-9972-4372-95de-b2e70c4dfbf5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:30.790570 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-4843f595-9972-4372-95de-b2e70c4dfbf5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:30.797021 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4843f595-9972-4372-95de-b2e70c4dfbf5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:30.797471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4843f595-9972-4372-95de-b2e70c4dfbf5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:30.798245 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4843f595-9972-4372-95de-b2e70c4dfbf5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:30.798872 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4843f595-9972-4372-95de-b2e70c4dfbf5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:30.938969 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-4843f595-9972-4372-95de-b2e70c4dfbf5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:30.948107 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-4843f595-9972-4372-95de-b2e70c4dfbf5 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1682 microversion: 2.1 time: 0.162615 Aug 03 12:16:30.948701 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 305/634] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:30 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:31.361172 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-be8175dc-a551-45f5-a35d-ab6c82881d27 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:31.362293 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-be8175dc-a551-45f5-a35d-ab6c82881d27 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:31.369807 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-be8175dc-a551-45f5-a35d-ab6c82881d27 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:31.370261 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-be8175dc-a551-45f5-a35d-ab6c82881d27 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:31.371125 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-be8175dc-a551-45f5-a35d-ab6c82881d27 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:31.371554 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-be8175dc-a551-45f5-a35d-ab6c82881d27 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:31.863220 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-be8175dc-a551-45f5-a35d-ab6c82881d27 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:31.872285 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-be8175dc-a551-45f5-a35d-ab6c82881d27 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1690 microversion: 2.1 time: 0.518365 Aug 03 12:16:31.873065 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 330/635] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:31 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1690 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:31.909909 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-1e660b72-594f-41ca-953d-7c958dabf875 req-ed2bc819-176f-44ab-97f6-0594ff5ae860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ef0b56c-b712-49ca-8847-a0acbc0a729a", "tag": "c2052327-4535-436a-9914-53604665eddd"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:31.912597 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-92e61d68-a05e-4230-9cc6-dd9f76872eab tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:31.913101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-92e61d68-a05e-4230-9cc6-dd9f76872eab tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:31.919944 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-92e61d68-a05e-4230-9cc6-dd9f76872eab tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:31.920391 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-92e61d68-a05e-4230-9cc6-dd9f76872eab tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:31.921166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-92e61d68-a05e-4230-9cc6-dd9f76872eab tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:31.921596 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-92e61d68-a05e-4230-9cc6-dd9f76872eab tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:31.922414 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-1e660b72-594f-41ca-953d-7c958dabf875 req-ed2bc819-176f-44ab-97f6-0594ff5ae860 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:31.922894 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-1e660b72-594f-41ca-953d-7c958dabf875 req-ed2bc819-176f-44ab-97f6-0594ff5ae860 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:31.935544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-1e660b72-594f-41ca-953d-7c958dabf875 req-ed2bc819-176f-44ab-97f6-0594ff5ae860 service nova] Creating event network-changed:c2052327-4535-436a-9914-53604665eddd for instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a on hv-cinder-83602 Aug 03 12:16:31.941290 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-1e660b72-594f-41ca-953d-7c958dabf875 req-ed2bc819-176f-44ab-97f6-0594ff5ae860 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035764 Aug 03 12:16:31.942064 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 306/636] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:31.972507 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-66451f0a-de0c-4601-99d9-337bc18b3fa7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:31.973363 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-66451f0a-de0c-4601-99d9-337bc18b3fa7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:31.980690 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-66451f0a-de0c-4601-99d9-337bc18b3fa7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:31.981144 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-66451f0a-de0c-4601-99d9-337bc18b3fa7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:31.982101 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-66451f0a-de0c-4601-99d9-337bc18b3fa7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:31.982957 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-66451f0a-de0c-4601-99d9-337bc18b3fa7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:32.008778 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-92e61d68-a05e-4230-9cc6-dd9f76872eab tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lazy-loading 'services' on Instance uuid 0ef0b56c-b712-49ca-8847-a0acbc0a729a {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:16:32.075460 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:32.089004 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-92e61d68-a05e-4230-9cc6-dd9f76872eab tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments/ab315102-5b54-448e-b8c6-6e29b011eb26" status: 202 len: 0 microversion: 2.1 time: 0.180199 Aug 03 12:16:32.089710 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 331/637] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 3 12:16:31 2022] DELETE /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments/ab315102-5b54-448e-b8c6-6e29b011eb26 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 12:16:32.099162 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9255f1ce-679e-4e8a-8883-0fe1ecee653e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:32.101607 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9255f1ce-679e-4e8a-8883-0fe1ecee653e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:32.109385 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9255f1ce-679e-4e8a-8883-0fe1ecee653e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:32.109988 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9255f1ce-679e-4e8a-8883-0fe1ecee653e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:32.110821 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9255f1ce-679e-4e8a-8883-0fe1ecee653e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:32.112222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9255f1ce-679e-4e8a-8883-0fe1ecee653e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:32.138311 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-66451f0a-de0c-4601-99d9-337bc18b3fa7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:32.145493 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9255f1ce-679e-4e8a-8883-0fe1ecee653e tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051228 Aug 03 12:16:32.146394 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 332/638] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:16:32 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:16:32.150812 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-66451f0a-de0c-4601-99d9-337bc18b3fa7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1682 microversion: 2.1 time: 0.178633 Aug 03 12:16:32.151518 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 307/639] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:31 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:16:32.893615 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e42000f9-688d-4f81-9daf-b22a11b143de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:32.894524 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e42000f9-688d-4f81-9daf-b22a11b143de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:32.901479 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e42000f9-688d-4f81-9daf-b22a11b143de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:32.901954 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e42000f9-688d-4f81-9daf-b22a11b143de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:32.902749 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e42000f9-688d-4f81-9daf-b22a11b143de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:32.903186 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e42000f9-688d-4f81-9daf-b22a11b143de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:33.041093 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e42000f9-688d-4f81-9daf-b22a11b143de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:33.048816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e42000f9-688d-4f81-9daf-b22a11b143de tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1690 microversion: 2.1 time: 0.159338 Aug 03 12:16:33.049383 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 333/640] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:32 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:33.157773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-8d992cc4-963d-47fa-865d-4f47a87cbcbc tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:33.160086 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-8d992cc4-963d-47fa-865d-4f47a87cbcbc tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:33.167319 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8d992cc4-963d-47fa-865d-4f47a87cbcbc tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:33.167772 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8d992cc4-963d-47fa-865d-4f47a87cbcbc tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:33.168586 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8d992cc4-963d-47fa-865d-4f47a87cbcbc tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:33.169031 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8d992cc4-963d-47fa-865d-4f47a87cbcbc tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:33.172074 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f58c65ae-0524-4b85-9edf-84c783ee03b7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:33.172699 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f58c65ae-0524-4b85-9edf-84c783ee03b7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:33.178816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f58c65ae-0524-4b85-9edf-84c783ee03b7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:33.179267 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f58c65ae-0524-4b85-9edf-84c783ee03b7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:33.180039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f58c65ae-0524-4b85-9edf-84c783ee03b7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:33.180476 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f58c65ae-0524-4b85-9edf-84c783ee03b7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:33.198579 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-8d992cc4-963d-47fa-865d-4f47a87cbcbc tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044834 Aug 03 12:16:33.199242 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 308/641] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:16:33 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:16:33.308978 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f58c65ae-0524-4b85-9edf-84c783ee03b7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:33.316436 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f58c65ae-0524-4b85-9edf-84c783ee03b7 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1682 microversion: 2.1 time: 0.148245 Aug 03 12:16:33.316999 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 334/642] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:33 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:16:34.069724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-32d64718-faef-4ca3-94da-52d1be63dfbe tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:34.069943 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-32d64718-faef-4ca3-94da-52d1be63dfbe tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:34.076194 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32d64718-faef-4ca3-94da-52d1be63dfbe tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:34.076659 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32d64718-faef-4ca3-94da-52d1be63dfbe tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:34.077477 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32d64718-faef-4ca3-94da-52d1be63dfbe tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:34.077923 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32d64718-faef-4ca3-94da-52d1be63dfbe tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:34.211252 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-08b0d75f-893e-4bee-bb27-176f4b49a573 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:34.213640 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-08b0d75f-893e-4bee-bb27-176f4b49a573 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:34.220738 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-08b0d75f-893e-4bee-bb27-176f4b49a573 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:34.221191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-08b0d75f-893e-4bee-bb27-176f4b49a573 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:34.221982 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-08b0d75f-893e-4bee-bb27-176f4b49a573 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:34.222467 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-08b0d75f-893e-4bee-bb27-176f4b49a573 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:34.229564 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-32d64718-faef-4ca3-94da-52d1be63dfbe tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:34.238291 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-32d64718-faef-4ca3-94da-52d1be63dfbe tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1690 microversion: 2.1 time: 0.172815 Aug 03 12:16:34.238963 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 309/643] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:34 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:34.255611 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-08b0d75f-893e-4bee-bb27-176f4b49a573 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048302 Aug 03 12:16:34.256202 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 335/644] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:16:34 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:16:34.338910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0121137e-e11e-4530-9f86-7e47d20e7b69 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:34.339537 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-0121137e-e11e-4530-9f86-7e47d20e7b69 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:34.346040 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0121137e-e11e-4530-9f86-7e47d20e7b69 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:34.346566 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0121137e-e11e-4530-9f86-7e47d20e7b69 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:34.347355 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0121137e-e11e-4530-9f86-7e47d20e7b69 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:34.347795 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0121137e-e11e-4530-9f86-7e47d20e7b69 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:34.680247 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-0121137e-e11e-4530-9f86-7e47d20e7b69 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:34.690598 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-0121137e-e11e-4530-9f86-7e47d20e7b69 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1682 microversion: 2.1 time: 0.355438 Aug 03 12:16:34.704232 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 310/645] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:34 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1682 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:16:35.272302 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3fd98642-00a6-4d83-b690-7915307a6b0d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:35.273093 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-34762b8e-8783-41eb-bcaf-d8d039123c9c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:35.275360 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3fd98642-00a6-4d83-b690-7915307a6b0d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:35.277351 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-34762b8e-8783-41eb-bcaf-d8d039123c9c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:35.291718 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3fd98642-00a6-4d83-b690-7915307a6b0d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:35.292818 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3fd98642-00a6-4d83-b690-7915307a6b0d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:35.295078 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3fd98642-00a6-4d83-b690-7915307a6b0d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:35.308973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-34762b8e-8783-41eb-bcaf-d8d039123c9c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:35.310238 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3fd98642-00a6-4d83-b690-7915307a6b0d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:35.312029 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-34762b8e-8783-41eb-bcaf-d8d039123c9c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:35.313664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-34762b8e-8783-41eb-bcaf-d8d039123c9c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:35.316280 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-34762b8e-8783-41eb-bcaf-d8d039123c9c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:35.373170 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-34762b8e-8783-41eb-bcaf-d8d039123c9c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107779 Aug 03 12:16:35.374345 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 311/646] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:16:35 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 12:16:35.386009 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e21ad9e0-c9d7-411f-b722-3fa0585c2657 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:35.386550 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e21ad9e0-c9d7-411f-b722-3fa0585c2657 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:35.400151 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e21ad9e0-c9d7-411f-b722-3fa0585c2657 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:35.400891 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e21ad9e0-c9d7-411f-b722-3fa0585c2657 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:35.401846 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e21ad9e0-c9d7-411f-b722-3fa0585c2657 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:35.406171 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e21ad9e0-c9d7-411f-b722-3fa0585c2657 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:35.589016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:35.594880 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-e21ad9e0-c9d7-411f-b722-3fa0585c2657 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] HTTP exception thrown: Instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a is not attached to volume ab315102-5b54-448e-b8c6-6e29b011eb26 Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e21ad9e0-c9d7-411f-b722-3fa0585c2657 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Request method failure captured: Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: DELETE /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments/ab315102-5b54-448e-b8c6-6e29b011eb26 HTTP/1.1 Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mZoehSxMyX0gMPULk_42C3l53OFUo6FdZ_shyBWW59CBKv9SJaWBkTZVZG3cgTK8nI1wjQi5lP3W-T7tw7vcZovxpi1ClFkEiPK2NW4Yo3Bn1GySwO0l1exoV9fNzFOfcHI8n3UWITgoVJw76RiXmpLGP55RpFL8zcW8hV_V32KGq8 Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 3156a99cf94e4845b22550fe2e064849 Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-TestMinimumBasicScenario-1719848663 Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:16:35.598283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:16:35.600531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3156a99cf94e4845b22550fe2e064849", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3156a99cf94e4845b22550fe2e064849"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3156a99cf94e4845b22550fe2e064849"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3156a99cf94e4845b22550fe2e064849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:16:35.600531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-TestMinimumBasicScenario-1719848663 Aug 03 12:16:35.600531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 3156a99cf94e4845b22550fe2e064849 Aug 03 12:16:35.600531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1719848663 Aug 03 12:16:35.600531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-TestMinimumBasicScenario-1719848663-project Aug 03 12:16:35.600531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:16:35.600531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:16:35.600531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 55d69ed62c5742d28c1f06175a02e17f Aug 03 12:16:35.600531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-TestMinimumBasicScenario-1719848663-project Aug 03 12:16:35.600531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:16:35.600531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a is not attached to volume ab315102-5b54-448e-b8c6-6e29b011eb26 Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'server_id': '0ef0b56c-b712-49ca-8847-a0acbc0a729a', 'id': 'ab315102-5b54-448e-b8c6-6e29b011eb26'} Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ab315102-5b54-448e-b8c6-6e29b011eb26. Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:16:35.601383 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a is not attached to volume ab315102-5b54-448e-b8c6-6e29b011eb26 Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a is not attached to volume ab315102-5b54-448e-b8c6-6e29b011eb26 Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:35.602973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e21ad9e0-c9d7-411f-b722-3fa0585c2657 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Returning 404 to user: Instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a is not attached to volume ab315102-5b54-448e-b8c6-6e29b011eb26 {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:16:35.604063 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e21ad9e0-c9d7-411f-b722-3fa0585c2657 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments/ab315102-5b54-448e-b8c6-6e29b011eb26" status: 404 len: 154 microversion: 2.1 time: 0.220075 Aug 03 12:16:35.606700 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 312/647] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 3 12:16:35 2022] DELETE /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a/os-volume_attachments/ab315102-5b54-448e-b8c6-6e29b011eb26 => generated 154 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:16:35.618032 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-612ae3dc-809e-4d78-a657-7bc55cfcd431 req-c2befbfc-dca4-4833-9bb1-080d782eb1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a", "name": "network-vif-deleted", "tag": "f10aded2-66f3-4213-be84-e7efad0f47ed"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:35.628864 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3fd98642-00a6-4d83-b690-7915307a6b0d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:35.638958 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3fd98642-00a6-4d83-b690-7915307a6b0d tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1690 microversion: 2.1 time: 0.380162 Aug 03 12:16:35.639565 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 336/648] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:35 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1690 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:35.655007 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-612ae3dc-809e-4d78-a657-7bc55cfcd431 req-c2befbfc-dca4-4833-9bb1-080d782eb1aa service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:35.655766 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-612ae3dc-809e-4d78-a657-7bc55cfcd431 req-c2befbfc-dca4-4833-9bb1-080d782eb1aa service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:35.671009 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-612ae3dc-809e-4d78-a657-7bc55cfcd431 req-c2befbfc-dca4-4833-9bb1-080d782eb1aa service nova] Creating event network-vif-deleted:f10aded2-66f3-4213-be84-e7efad0f47ed for instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a on hv-cinder-83602 Aug 03 12:16:35.678274 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-612ae3dc-809e-4d78-a657-7bc55cfcd431 req-c2befbfc-dca4-4833-9bb1-080d782eb1aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068241 Aug 03 12:16:35.679925 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 313/649] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:35.713299 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-51640cb8-38d9-469d-911b-5245e0f5aa05 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:35.713956 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-51640cb8-38d9-469d-911b-5245e0f5aa05 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:35.720567 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-51640cb8-38d9-469d-911b-5245e0f5aa05 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:35.721371 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-51640cb8-38d9-469d-911b-5245e0f5aa05 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:35.722395 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-51640cb8-38d9-469d-911b-5245e0f5aa05 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:35.723020 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-51640cb8-38d9-469d-911b-5245e0f5aa05 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:35.770481 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-51640cb8-38d9-469d-911b-5245e0f5aa05 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:35.771138 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-51640cb8-38d9-469d-911b-5245e0f5aa05 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:35.772014 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-51640cb8-38d9-469d-911b-5245e0f5aa05 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lazy-loading 'fault' on Instance uuid afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:16:35.824647 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-51640cb8-38d9-469d-911b-5245e0f5aa05 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:35.840696 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-51640cb8-38d9-469d-911b-5245e0f5aa05 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 200 len: 1332 microversion: 2.1 time: 0.130869 Aug 03 12:16:35.842250 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 337/650] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:35 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 1332 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:36.537049 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-4fc87ef4-711f-4a82-be76-45b407887a5e req-da445421-e769-41ac-a7a6-c5ec57d207ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b98bd00-4a41-43d7-a5c6-ff4644582d13", "name": "network-vif-deleted", "tag": "2946f3bb-8068-403a-8fc7-8e8c09e8d7c8"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:36.574962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-4fc87ef4-711f-4a82-be76-45b407887a5e req-da445421-e769-41ac-a7a6-c5ec57d207ae service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:36.576263 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-4fc87ef4-711f-4a82-be76-45b407887a5e req-da445421-e769-41ac-a7a6-c5ec57d207ae service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:36.612404 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-4fc87ef4-711f-4a82-be76-45b407887a5e req-da445421-e769-41ac-a7a6-c5ec57d207ae service nova] Creating event network-vif-deleted:2946f3bb-8068-403a-8fc7-8e8c09e8d7c8 for instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 on hv-cinder-83602 Aug 03 12:16:36.626492 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-4fc87ef4-711f-4a82-be76-45b407887a5e req-da445421-e769-41ac-a7a6-c5ec57d207ae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093364 Aug 03 12:16:36.627716 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 314/651] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:36.663014 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e75ada8d-179c-4c44-8be0-81f2668e92da tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:36.663674 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e75ada8d-179c-4c44-8be0-81f2668e92da tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:36.673689 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e75ada8d-179c-4c44-8be0-81f2668e92da tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:36.674133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e75ada8d-179c-4c44-8be0-81f2668e92da tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:36.675117 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e75ada8d-179c-4c44-8be0-81f2668e92da tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:36.675806 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e75ada8d-179c-4c44-8be0-81f2668e92da tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:36.771661 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e75ada8d-179c-4c44-8be0-81f2668e92da tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:36.780307 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e75ada8d-179c-4c44-8be0-81f2668e92da tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1330 microversion: 2.1 time: 0.122304 Aug 03 12:16:36.780898 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 338/652] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:36 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1330 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:36.819348 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d7225cca-2dc0-4acb-9764-e16808ddafc2 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:36.820075 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d7225cca-2dc0-4acb-9764-e16808ddafc2 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:36.826816 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d7225cca-2dc0-4acb-9764-e16808ddafc2 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:36.827257 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d7225cca-2dc0-4acb-9764-e16808ddafc2 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:36.828242 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d7225cca-2dc0-4acb-9764-e16808ddafc2 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:36.828698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d7225cca-2dc0-4acb-9764-e16808ddafc2 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:36.857795 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d7225cca-2dc0-4acb-9764-e16808ddafc2 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Going to try to terminate instance {{(pid=117911) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:16:36.867035 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-670e9d61-267d-4be3-af09-0e3e1fc433df tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:36.868234 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-670e9d61-267d-4be3-af09-0e3e1fc433df tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:36.883050 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-670e9d61-267d-4be3-af09-0e3e1fc433df tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:36.883765 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-670e9d61-267d-4be3-af09-0e3e1fc433df tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:36.884844 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-670e9d61-267d-4be3-af09-0e3e1fc433df tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:36.885457 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-670e9d61-267d-4be3-af09-0e3e1fc433df tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:36.905327 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-670e9d61-267d-4be3-af09-0e3e1fc433df tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-670e9d61-267d-4be3-af09-0e3e1fc433df tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a HTTP/1.1 Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:16:36.907624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:16:36.909266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:16:36.909266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:16:36.909266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:16:36.909266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:16:36.909266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:16:36.909266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:16:36.909266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:16:36.909266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:16:36.909266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:16:36.909266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:16:36.909266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:16:36.909266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a'} Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:16:36.910135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:16:36.911592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:36.914080 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-670e9d61-267d-4be3-af09-0e3e1fc433df tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 404 to user: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:16:36.916270 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-670e9d61-267d-4be3-af09-0e3e1fc433df tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 404 len: 111 microversion: 2.1 time: 0.053798 Aug 03 12:16:36.918375 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 339/653] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:36 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 12:16:36.928460 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5b2fa3e5-e6c5-4518-999e-253e1acf0451 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '.version_select at 0x7f14d6fe2280>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:36.956798 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5b2fa3e5-e6c5-4518-999e-253e1acf0451 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1495821952" status: 202 len: 0 microversion: 2.1 time: 0.033382 Aug 03 12:16:36.976566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 340/654] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 3 12:16:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1495821952 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:16:36.994648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d7225cca-2dc0-4acb-9764-e16808ddafc2 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 204 len: 0 microversion: 2.1 time: 0.180419 Aug 03 12:16:36.998698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 315/655] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:16:36 2022] DELETE /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 12:16:37.022181 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0d5e7229-f04a-4948-b56f-1483f1b98296 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:37.036217 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0d5e7229-f04a-4948-b56f-1483f1b98296 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:37.043969 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0d5e7229-f04a-4948-b56f-1483f1b98296 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:37.044590 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0d5e7229-f04a-4948-b56f-1483f1b98296 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:37.045757 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0d5e7229-f04a-4948-b56f-1483f1b98296 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:37.046301 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0d5e7229-f04a-4948-b56f-1483f1b98296 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:37.297598 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0d5e7229-f04a-4948-b56f-1483f1b98296 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:37.305857 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0d5e7229-f04a-4948-b56f-1483f1b98296 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1554 microversion: 2.1 time: 0.304568 Aug 03 12:16:37.306645 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 341/656] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:36 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1554 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:37.816956 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4db7b71d-4831-49b1-8e01-8f722fcb018a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:37.817683 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-4db7b71d-4831-49b1-8e01-8f722fcb018a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:37.825435 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4db7b71d-4831-49b1-8e01-8f722fcb018a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:37.825895 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4db7b71d-4831-49b1-8e01-8f722fcb018a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:37.826741 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4db7b71d-4831-49b1-8e01-8f722fcb018a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:37.827468 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4db7b71d-4831-49b1-8e01-8f722fcb018a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:37.852127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-90162e2a-12c1-46a0-b3cc-ddd6b7fe9f85 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Action: 'create', calling method: .version_select at 0x7f14dc0339d0>, body: {"keypair": {"name": "tempest-keypair-2088793282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA8biYdZACrZdI19uBhUBV8P63HtV4htu01JBPH4DuDx2EC0xOZj31wDe02M3c3J6ptgFIblqqGzQ6XI9woCsuR7lOnXHveeQkK/8aXzUQbRzedmJLjIFXIAHOl2Cr7Kg=="}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:37.866063 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4db7b71d-4831-49b1-8e01-8f722fcb018a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:37.866567 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4db7b71d-4831-49b1-8e01-8f722fcb018a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:37.867031 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-4db7b71d-4831-49b1-8e01-8f722fcb018a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lazy-loading 'fault' on Instance uuid 2b98bd00-4a41-43d7-a5c6-ff4644582d13 {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:16:37.877222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-90162e2a-12c1-46a0-b3cc-ddd6b7fe9f85 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:16:37.881426 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-90162e2a-12c1-46a0-b3cc-ddd6b7fe9f85 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for user e7566583228946488bd1ab647bbe8059 and project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'key_pairs'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:16:37.905890 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-90162e2a-12c1-46a0-b3cc-ddd6b7fe9f85 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058204 Aug 03 12:16:37.906946 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 342/657] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 3 12:16:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:37.915080 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-4db7b71d-4831-49b1-8e01-8f722fcb018a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:37.923245 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-4db7b71d-4831-49b1-8e01-8f722fcb018a tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 200 len: 1335 microversion: 2.1 time: 0.110503 Aug 03 12:16:37.923825 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 316/658] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:37 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:38.328537 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-aa24bda5-8b8f-4ea7-9d50-5df7d8f04c55 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:38.329320 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-aa24bda5-8b8f-4ea7-9d50-5df7d8f04c55 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:38.336843 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-aa24bda5-8b8f-4ea7-9d50-5df7d8f04c55 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:38.337432 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-aa24bda5-8b8f-4ea7-9d50-5df7d8f04c55 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:38.338526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-aa24bda5-8b8f-4ea7-9d50-5df7d8f04c55 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:38.339289 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-aa24bda5-8b8f-4ea7-9d50-5df7d8f04c55 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:38.580742 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-aa24bda5-8b8f-4ea7-9d50-5df7d8f04c55 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:38.588512 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-aa24bda5-8b8f-4ea7-9d50-5df7d8f04c55 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1554 microversion: 2.1 time: 0.264175 Aug 03 12:16:38.589119 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 343/659] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:38 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1554 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:38.952404 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c910cd49-25ab-4420-994c-ff4425431156 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:38.953160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-c910cd49-25ab-4420-994c-ff4425431156 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2b98bd00-4a41-43d7-a5c6-ff4644582d13] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:38.960610 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c910cd49-25ab-4420-994c-ff4425431156 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:38.961145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c910cd49-25ab-4420-994c-ff4425431156 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:38.962026 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c910cd49-25ab-4420-994c-ff4425431156 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:38.962482 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c910cd49-25ab-4420-994c-ff4425431156 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:38.990398 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-c910cd49-25ab-4420-994c-ff4425431156 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] HTTP exception thrown: Instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 could not be found. Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c910cd49-25ab-4420-994c-ff4425431156 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Request method failure captured: Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 HTTP/1.1 Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXpGgstOLCAy1IlP8axU4h3RqjCWiCOjN6ADxKbHRwEqWKAJbyQSVt-GY6L_iKrgzC0QBQEwSacUOcec64z9asz0SHu9FitUawVbzLJtXhCKgLQERKvuYBNI9_B_4tm1yF1ahiKM6J-qYB618EPmimAvbmvR6h-16Prn4spPy7fhlo Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: d51be67fb4974085b55f3dcfcc2c70aa Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:16:38.992639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:16:38.994168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d51be67fb4974085b55f3dcfcc2c70aa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:16:38.994168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:16:38.994168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: d51be67fb4974085b55f3dcfcc2c70aa Aug 03 12:16:38.994168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:16:38.994168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-ServerRescueNegativeTestJSON-350268690-project Aug 03 12:16:38.994168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:16:38.994168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:16:38.994168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: cde9db32ba1c4810833f8fd824536347 Aug 03 12:16:38.994168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-ServerRescueNegativeTestJSON-350268690-project Aug 03 12:16:38.994168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:16:38.994168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 could not be found. Aug 03 12:16:38.994168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': '2b98bd00-4a41-43d7-a5c6-ff4644582d13'} Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 could not be found. Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:16:38.995084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 could not be found. Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 could not be found. Aug 03 12:16:38.996455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:38.997759 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c910cd49-25ab-4420-994c-ff4425431156 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Returning 404 to user: Instance 2b98bd00-4a41-43d7-a5c6-ff4644582d13 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:16:38.997759 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c910cd49-25ab-4420-994c-ff4425431156 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13" status: 404 len: 111 microversion: 2.1 time: 0.049835 Aug 03 12:16:38.997759 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 317/660] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:38 2022] GET /compute/v2.1/servers/2b98bd00-4a41-43d7-a5c6-ff4644582d13 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:16:39.006328 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8c219810-20e7-46ac-bb0d-abf399a159cf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '.version_select at 0x7f14dc0338b0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:39.046915 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8c219810-20e7-46ac-bb0d-abf399a159cf tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732403474" status: 202 len: 0 microversion: 2.1 time: 0.046063 Aug 03 12:16:39.047611 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 344/661] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 3 12:16:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732403474 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:16:39.596459 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-f8147901-c873-46ce-97b5-a98977ce7d4f req-0206fe91-6e1b-44c6-8d8f-b313deec50bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef0b56c-b712-49ca-8847-a0acbc0a729a", "name": "network-vif-deleted", "tag": "c2052327-4535-436a-9914-53604665eddd"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:39.609454 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-f8147901-c873-46ce-97b5-a98977ce7d4f req-0206fe91-6e1b-44c6-8d8f-b313deec50bf service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:39.610268 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-f8147901-c873-46ce-97b5-a98977ce7d4f req-0206fe91-6e1b-44c6-8d8f-b313deec50bf service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:39.610878 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1b8596e3-3521-49f9-80c5-274046193c78 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:39.611705 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1b8596e3-3521-49f9-80c5-274046193c78 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:39.619386 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1b8596e3-3521-49f9-80c5-274046193c78 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:39.620196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1b8596e3-3521-49f9-80c5-274046193c78 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:39.621591 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1b8596e3-3521-49f9-80c5-274046193c78 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:39.622711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1b8596e3-3521-49f9-80c5-274046193c78 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:39.630336 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-f8147901-c873-46ce-97b5-a98977ce7d4f req-0206fe91-6e1b-44c6-8d8f-b313deec50bf service nova] Creating event network-vif-deleted:c2052327-4535-436a-9914-53604665eddd for instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a on hv-cinder-83602 Aug 03 12:16:39.637786 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-f8147901-c873-46ce-97b5-a98977ce7d4f req-0206fe91-6e1b-44c6-8d8f-b313deec50bf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045379 Aug 03 12:16:39.639877 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 318/662] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:39.693512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-446504663", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a64e775-73b7-4e56-9c06-9163d23fd664"}], "security_groups": [{"name": "tempest-securitygroup--1742991947"}], "key_name": "tempest-keypair-2088793282", "user_data": "}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:39.726653 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1b8596e3-3521-49f9-80c5-274046193c78 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d69ed62c5742d28c1f06175a02e17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3156a99cf94e4845b22550fe2e064849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:39.737052 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1b8596e3-3521-49f9-80c5-274046193c78 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 200 len: 1344 microversion: 2.1 time: 0.129935 Aug 03 12:16:39.738412 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 345/663] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:39 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 1344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:16:39.826424 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.network.neutron [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] validate_networks() for [('5a64e775-73b7-4e56-9c06-9163d23fd664', None, None, None, None, None)] {{(pid=117911) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:16:40.410858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Flavor limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:16:40.412474 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Image limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:16:40.413036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Flavor pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:16:40.413457 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Image pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:16:40.413922 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:16:40.423805 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:40.424249 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:40.425027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:40.425458 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:40.445695 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:16:40.450153 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Getting quotas for user e7566583228946488bd1ab647bbe8059 and project 04bd0b93ac8140559e3ddfe51cc2cdaf. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:16:40.465155 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Going to run 1 instances... {{(pid=117911) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:16:40.467975 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:16:40.525067 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-658f1e81-a904-4132-aa7d-19d0224dcc47 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.835977 Aug 03 12:16:40.533060 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 319/664] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:16:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 12:16:40.540691 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-34e2bdf1-fdca-4bd2-b74d-7a367f0efbb3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:40.542293 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-34e2bdf1-fdca-4bd2-b74d-7a367f0efbb3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:40.546243 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:40.622550 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-34e2bdf1-fdca-4bd2-b74d-7a367f0efbb3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:40.630011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-34e2bdf1-fdca-4bd2-b74d-7a367f0efbb3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1241 microversion: 2.1 time: 0.095244 Aug 03 12:16:40.631130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 346/665] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:40 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:40.760718 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0e60d203-788a-4f93-98d7-8a146bbb4e44 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:40.761750 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-0e60d203-788a-4f93-98d7-8a146bbb4e44 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] [instance: 0ef0b56c-b712-49ca-8847-a0acbc0a729a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:40.772939 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0e60d203-788a-4f93-98d7-8a146bbb4e44 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:40.773524 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0e60d203-788a-4f93-98d7-8a146bbb4e44 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:40.774771 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0e60d203-788a-4f93-98d7-8a146bbb4e44 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:40.775301 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0e60d203-788a-4f93-98d7-8a146bbb4e44 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:40.791012 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-0e60d203-788a-4f93-98d7-8a146bbb4e44 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] HTTP exception thrown: Instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a could not be found. Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0e60d203-788a-4f93-98d7-8a146bbb4e44 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Request method failure captured: Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a HTTP/1.1 Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mZoehSxMyX0gMPULk_42C3l53OFUo6FdZ_shyBWW59CBKv9SJaWBkTZVZG3cgTK8nI1wjQi5lP3W-T7tw7vcZovxpi1ClFkEiPK2NW4Yo3Bn1GySwO0l1exoV9fNzFOfcHI8n3UWITgoVJw76RiXmpLGP55RpFL8zcW8hV_V32KGq8 Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 3156a99cf94e4845b22550fe2e064849 Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-TestMinimumBasicScenario-1719848663 Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:16:40.792679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:16:40.794238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3156a99cf94e4845b22550fe2e064849", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3156a99cf94e4845b22550fe2e064849"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3156a99cf94e4845b22550fe2e064849"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3156a99cf94e4845b22550fe2e064849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:16:40.794238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-TestMinimumBasicScenario-1719848663 Aug 03 12:16:40.794238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 3156a99cf94e4845b22550fe2e064849 Aug 03 12:16:40.794238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1719848663 Aug 03 12:16:40.794238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-TestMinimumBasicScenario-1719848663-project Aug 03 12:16:40.794238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:16:40.794238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:16:40.794238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 55d69ed62c5742d28c1f06175a02e17f Aug 03 12:16:40.794238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-TestMinimumBasicScenario-1719848663-project Aug 03 12:16:40.794238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:16:40.794238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a could not be found. Aug 03 12:16:40.794238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': '0ef0b56c-b712-49ca-8847-a0acbc0a729a'} Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a could not be found. Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:16:40.795145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a could not be found. Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a could not be found. Aug 03 12:16:40.796608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:40.798010 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0e60d203-788a-4f93-98d7-8a146bbb4e44 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Returning 404 to user: Instance 0ef0b56c-b712-49ca-8847-a0acbc0a729a could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:16:40.798010 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-0e60d203-788a-4f93-98d7-8a146bbb4e44 tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a" status: 404 len: 111 microversion: 2.1 time: 0.037702 Aug 03 12:16:40.798754 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 320/666] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:40 2022] GET /compute/v2.1/servers/0ef0b56c-b712-49ca-8847-a0acbc0a729a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:16:40.803148 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-534fcd47-b33d-43dc-bf19-c7afb7a47d7c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] Calling method '.version_select at 0x7f14d6f651f0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:40.824702 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-534fcd47-b33d-43dc-bf19-c7afb7a47d7c tempest-TestMinimumBasicScenario-1719848663 tempest-TestMinimumBasicScenario-1719848663-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1378938440" status: 202 len: 0 microversion: 2.1 time: 0.025237 Aug 03 12:16:40.825287 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 347/667] 10.222.0.17 () {58 vars in 1272 bytes} [Wed Aug 3 12:16:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1378938440 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:16:41.653482 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-aa1da077-3de3-45fc-9a24-e2069853421d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:41.654422 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-aa1da077-3de3-45fc-9a24-e2069853421d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:41.662145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-aa1da077-3de3-45fc-9a24-e2069853421d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:41.662647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-aa1da077-3de3-45fc-9a24-e2069853421d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:41.663434 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-aa1da077-3de3-45fc-9a24-e2069853421d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:41.663864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-aa1da077-3de3-45fc-9a24-e2069853421d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:41.774786 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-aa1da077-3de3-45fc-9a24-e2069853421d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:41.786065 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-aa1da077-3de3-45fc-9a24-e2069853421d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1293 microversion: 2.1 time: 0.136877 Aug 03 12:16:41.787815 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 321/668] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:41 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1293 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:42.545713 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d1edb5c2-0fb6-4010-b57c-6a3b81cf0608 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:42.547066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d1edb5c2-0fb6-4010-b57c-6a3b81cf0608 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:42.555272 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d1edb5c2-0fb6-4010-b57c-6a3b81cf0608 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:42.555991 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d1edb5c2-0fb6-4010-b57c-6a3b81cf0608 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:42.557280 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d1edb5c2-0fb6-4010-b57c-6a3b81cf0608 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:42.557907 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d1edb5c2-0fb6-4010-b57c-6a3b81cf0608 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:42.621850 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d1edb5c2-0fb6-4010-b57c-6a3b81cf0608 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:16:42.795853 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d1edb5c2-0fb6-4010-b57c-6a3b81cf0608 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "DELETE /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 204 len: 0 microversion: 2.1 time: 0.252771 Aug 03 12:16:42.798488 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 348/669] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:16:42 2022] DELETE /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 12:16:42.813379 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e1d892d9-c367-471f-bb98-44b482abf208 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:42.816754 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e1d892d9-c367-471f-bb98-44b482abf208 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:42.820306 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b2bfb841-1360-4fb1-82f4-24263c0215bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:42.822542 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b2bfb841-1360-4fb1-82f4-24263c0215bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:42.826691 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e1d892d9-c367-471f-bb98-44b482abf208 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:42.827531 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e1d892d9-c367-471f-bb98-44b482abf208 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:42.828567 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e1d892d9-c367-471f-bb98-44b482abf208 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:42.829430 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e1d892d9-c367-471f-bb98-44b482abf208 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:42.832827 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b2bfb841-1360-4fb1-82f4-24263c0215bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:42.834527 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b2bfb841-1360-4fb1-82f4-24263c0215bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:42.835753 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b2bfb841-1360-4fb1-82f4-24263c0215bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:42.837078 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b2bfb841-1360-4fb1-82f4-24263c0215bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:43.129091 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e1d892d9-c367-471f-bb98-44b482abf208 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:43.145589 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e1d892d9-c367-471f-bb98-44b482abf208 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1507 microversion: 2.1 time: 0.340737 Aug 03 12:16:43.147693 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 322/670] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:42 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1507 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:43.443359 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b2bfb841-1360-4fb1-82f4-24263c0215bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:43.462569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b2bfb841-1360-4fb1-82f4-24263c0215bc tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1367 microversion: 2.1 time: 0.656857 Aug 03 12:16:43.463711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 349/671] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:42 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1367 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:43.752230 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-8b0d36d0-522c-486d-9127-48455c2ce670 req-b20cd2c2-678c-46da-b318-d9447b98d464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad9eeba-c0de-4b84-94ca-4a6a2253ea09", "tag": "3ef595c4-cb1e-4ae4-b2b5-8ced39865114"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:43.763555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-8b0d36d0-522c-486d-9127-48455c2ce670 req-b20cd2c2-678c-46da-b318-d9447b98d464 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:43.764266 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-8b0d36d0-522c-486d-9127-48455c2ce670 req-b20cd2c2-678c-46da-b318-d9447b98d464 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:43.777315 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-8b0d36d0-522c-486d-9127-48455c2ce670 req-b20cd2c2-678c-46da-b318-d9447b98d464 service nova] Creating event network-changed:3ef595c4-cb1e-4ae4-b2b5-8ced39865114 for instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 on hv-cinder-83602 Aug 03 12:16:43.783105 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-8b0d36d0-522c-486d-9127-48455c2ce670 req-b20cd2c2-678c-46da-b318-d9447b98d464 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034459 Aug 03 12:16:43.784305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 323/672] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:16:44.168842 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-759b53b3-8b90-4e74-9454-5d96a08f2697 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:44.170106 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-759b53b3-8b90-4e74-9454-5d96a08f2697 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:44.179038 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-759b53b3-8b90-4e74-9454-5d96a08f2697 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:44.180093 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-759b53b3-8b90-4e74-9454-5d96a08f2697 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:44.181483 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-759b53b3-8b90-4e74-9454-5d96a08f2697 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:44.182573 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-759b53b3-8b90-4e74-9454-5d96a08f2697 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:44.475166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-759b53b3-8b90-4e74-9454-5d96a08f2697 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:44.493352 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c7033c58-17d0-43ec-a947-2046c59da56c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:44.496690 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-c7033c58-17d0-43ec-a947-2046c59da56c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:44.506807 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-759b53b3-8b90-4e74-9454-5d96a08f2697 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1507 microversion: 2.1 time: 0.341891 Aug 03 12:16:44.507878 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 350/673] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:44 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1507 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:44.518732 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c7033c58-17d0-43ec-a947-2046c59da56c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:44.519280 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c7033c58-17d0-43ec-a947-2046c59da56c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:44.522128 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c7033c58-17d0-43ec-a947-2046c59da56c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:44.522128 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c7033c58-17d0-43ec-a947-2046c59da56c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:44.730207 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-c7033c58-17d0-43ec-a947-2046c59da56c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:44.742038 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c7033c58-17d0-43ec-a947-2046c59da56c tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1367 microversion: 2.1 time: 0.256451 Aug 03 12:16:44.744406 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 324/674] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:44 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:45.533111 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-df953139-bc1f-4c75-83e6-3e0d58fc7db4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:45.535414 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-df953139-bc1f-4c75-83e6-3e0d58fc7db4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:45.550713 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df953139-bc1f-4c75-83e6-3e0d58fc7db4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:45.554498 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df953139-bc1f-4c75-83e6-3e0d58fc7db4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:45.560543 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df953139-bc1f-4c75-83e6-3e0d58fc7db4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:45.562070 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df953139-bc1f-4c75-83e6-3e0d58fc7db4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:45.768196 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-236269a7-98a3-4ceb-aaf3-c7ddadf54ee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:45.769779 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-236269a7-98a3-4ceb-aaf3-c7ddadf54ee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:45.781649 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-236269a7-98a3-4ceb-aaf3-c7ddadf54ee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:45.782544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-236269a7-98a3-4ceb-aaf3-c7ddadf54ee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:45.784610 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-236269a7-98a3-4ceb-aaf3-c7ddadf54ee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:45.785283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-236269a7-98a3-4ceb-aaf3-c7ddadf54ee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:45.798189 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-df953139-bc1f-4c75-83e6-3e0d58fc7db4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:45.811276 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-df953139-bc1f-4c75-83e6-3e0d58fc7db4 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1507 microversion: 2.1 time: 0.284561 Aug 03 12:16:45.812464 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 351/675] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:45 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1507 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:46.120927 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-236269a7-98a3-4ceb-aaf3-c7ddadf54ee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:46.140985 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-236269a7-98a3-4ceb-aaf3-c7ddadf54ee2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1367 microversion: 2.1 time: 0.378302 Aug 03 12:16:46.156334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 325/676] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:45 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:16:46.609044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-2873375c-e684-486b-87e7-61f9b3071d8c req-13c1fcfd-e4cb-47e4-9965-5feeb92766dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf9a529-07b3-4797-bc51-75b210ae9933", "name": "network-vif-deleted", "tag": "d86d0e52-6fc7-4559-85a8-02b7160a4f64"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:46.620470 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-2873375c-e684-486b-87e7-61f9b3071d8c req-13c1fcfd-e4cb-47e4-9965-5feeb92766dc service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:46.621014 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-2873375c-e684-486b-87e7-61f9b3071d8c req-13c1fcfd-e4cb-47e4-9965-5feeb92766dc service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:46.625755 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:46.635970 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-2873375c-e684-486b-87e7-61f9b3071d8c req-13c1fcfd-e4cb-47e4-9965-5feeb92766dc service nova] Creating event network-vif-deleted:d86d0e52-6fc7-4559-85a8-02b7160a4f64 for instance abf9a529-07b3-4797-bc51-75b210ae9933 on hv-cinder-83602 Aug 03 12:16:46.640994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-2873375c-e684-486b-87e7-61f9b3071d8c req-13c1fcfd-e4cb-47e4-9965-5feeb92766dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112313 Aug 03 12:16:46.641608 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 352/677] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:46.836548 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-63087c30-8d37-42b5-8ef2-84ff386a4060 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:46.837714 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-63087c30-8d37-42b5-8ef2-84ff386a4060 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:46.842244 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:46.853635 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-63087c30-8d37-42b5-8ef2-84ff386a4060 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:46.854508 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-63087c30-8d37-42b5-8ef2-84ff386a4060 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:46.855953 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-63087c30-8d37-42b5-8ef2-84ff386a4060 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:46.856766 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-63087c30-8d37-42b5-8ef2-84ff386a4060 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:46.954853 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-63087c30-8d37-42b5-8ef2-84ff386a4060 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:46.967807 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-63087c30-8d37-42b5-8ef2-84ff386a4060 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 200 len: 1465 microversion: 2.1 time: 0.136553 Aug 03 12:16:46.969391 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 326/678] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:46 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 1465 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:47.163396 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ed79685d-67d0-4d9d-a8da-f2254f0dcb6b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:47.164109 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ed79685d-67d0-4d9d-a8da-f2254f0dcb6b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:47.170836 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed79685d-67d0-4d9d-a8da-f2254f0dcb6b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:47.171296 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed79685d-67d0-4d9d-a8da-f2254f0dcb6b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:47.172077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed79685d-67d0-4d9d-a8da-f2254f0dcb6b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:47.172515 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed79685d-67d0-4d9d-a8da-f2254f0dcb6b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:47.343148 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ed79685d-67d0-4d9d-a8da-f2254f0dcb6b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:47.351029 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ed79685d-67d0-4d9d-a8da-f2254f0dcb6b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1367 microversion: 2.1 time: 0.192283 Aug 03 12:16:47.351872 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 353/679] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:47 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:47.989676 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-30bb56f2-6a64-442e-9ada-1cef3546201e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:47.990324 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-30bb56f2-6a64-442e-9ada-1cef3546201e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: abf9a529-07b3-4797-bc51-75b210ae9933] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:47.997140 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-30bb56f2-6a64-442e-9ada-1cef3546201e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:47.997594 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-30bb56f2-6a64-442e-9ada-1cef3546201e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:47.998375 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-30bb56f2-6a64-442e-9ada-1cef3546201e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:47.998849 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-30bb56f2-6a64-442e-9ada-1cef3546201e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:48.015435 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-30bb56f2-6a64-442e-9ada-1cef3546201e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] HTTP exception thrown: Instance abf9a529-07b3-4797-bc51-75b210ae9933 could not be found. Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-30bb56f2-6a64-442e-9ada-1cef3546201e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Request method failure captured: Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 HTTP/1.1 Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXpGgstOLCAy1IlP8axU4h3RqjCWiCOjN6ADxKbHRwEqWKAJbyQSVt-GY6L_iKrgzC0QBQEwSacUOcec64z9asz0SHu9FitUawVbzLJtXhCKgLQERKvuYBNI9_B_4tm1yF1ahiKM6J-qYB618EPmimAvbmvR6h-16Prn4spPy7fhlo Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: d51be67fb4974085b55f3dcfcc2c70aa Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:16:48.017027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:16:48.018698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d51be67fb4974085b55f3dcfcc2c70aa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:16:48.018698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:16:48.018698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: d51be67fb4974085b55f3dcfcc2c70aa Aug 03 12:16:48.018698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:16:48.018698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-ServerRescueNegativeTestJSON-350268690-project Aug 03 12:16:48.018698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:16:48.018698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:16:48.018698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: cde9db32ba1c4810833f8fd824536347 Aug 03 12:16:48.018698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-ServerRescueNegativeTestJSON-350268690-project Aug 03 12:16:48.018698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:16:48.018698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance abf9a529-07b3-4797-bc51-75b210ae9933 could not be found. Aug 03 12:16:48.018698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'abf9a529-07b3-4797-bc51-75b210ae9933'} Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abf9a529-07b3-4797-bc51-75b210ae9933 could not be found. Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:16:48.019858 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abf9a529-07b3-4797-bc51-75b210ae9933 could not be found. Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abf9a529-07b3-4797-bc51-75b210ae9933 could not be found. Aug 03 12:16:48.021893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:16:48.024143 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-30bb56f2-6a64-442e-9ada-1cef3546201e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Returning 404 to user: Instance abf9a529-07b3-4797-bc51-75b210ae9933 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:16:48.024143 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-30bb56f2-6a64-442e-9ada-1cef3546201e tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933" status: 404 len: 111 microversion: 2.1 time: 0.033244 Aug 03 12:16:48.024143 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 327/680] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:47 2022] GET /compute/v2.1/servers/abf9a529-07b3-4797-bc51-75b210ae9933 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:16:48.031427 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4f806a57-2567-4aa4-877f-4f2d0a42a797 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:48.032175 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4f806a57-2567-4aa4-877f-4f2d0a42a797 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:48.041329 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f806a57-2567-4aa4-877f-4f2d0a42a797 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:48.042808 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f806a57-2567-4aa4-877f-4f2d0a42a797 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:48.043777 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f806a57-2567-4aa4-877f-4f2d0a42a797 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:48.044349 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4f806a57-2567-4aa4-877f-4f2d0a42a797 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:48.095575 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4f806a57-2567-4aa4-877f-4f2d0a42a797 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:16:48.188333 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4f806a57-2567-4aa4-877f-4f2d0a42a797 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 204 len: 0 microversion: 2.1 time: 0.161865 Aug 03 12:16:48.189282 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 354/681] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:16:48 2022] DELETE /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:16:48.201384 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ef5454f6-37a1-4d64-b944-839397614575 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:48.203074 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-ef5454f6-37a1-4d64-b944-839397614575 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:48.217752 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ef5454f6-37a1-4d64-b944-839397614575 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:48.218602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ef5454f6-37a1-4d64-b944-839397614575 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:48.220044 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ef5454f6-37a1-4d64-b944-839397614575 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:48.220842 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ef5454f6-37a1-4d64-b944-839397614575 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:48.375881 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a6deedc3-fb48-429c-8bef-55a0feac0ee0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:48.376598 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a6deedc3-fb48-429c-8bef-55a0feac0ee0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:48.383791 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a6deedc3-fb48-429c-8bef-55a0feac0ee0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:48.384244 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a6deedc3-fb48-429c-8bef-55a0feac0ee0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:48.385037 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a6deedc3-fb48-429c-8bef-55a0feac0ee0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:48.385483 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a6deedc3-fb48-429c-8bef-55a0feac0ee0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:48.553146 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a6deedc3-fb48-429c-8bef-55a0feac0ee0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:48.562878 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a6deedc3-fb48-429c-8bef-55a0feac0ee0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1367 microversion: 2.1 time: 0.192816 Aug 03 12:16:48.574589 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 355/682] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:48 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:48.604191 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ef5454f6-37a1-4d64-b944-839397614575 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:48.612834 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ef5454f6-37a1-4d64-b944-839397614575 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.417513 Aug 03 12:16:48.613416 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 328/683] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:48 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:48.994730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b9752881-ac0e-49b3-93c3-594426375904 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:48.995615 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b9752881-ac0e-49b3-93c3-594426375904 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:49.003011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b9752881-ac0e-49b3-93c3-594426375904 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:49.003662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b9752881-ac0e-49b3-93c3-594426375904 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:49.004823 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b9752881-ac0e-49b3-93c3-594426375904 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:49.005488 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b9752881-ac0e-49b3-93c3-594426375904 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:49.035444 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b9752881-ac0e-49b3-93c3-594426375904 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:16:49.140127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b9752881-ac0e-49b3-93c3-594426375904 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "DELETE /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 204 len: 0 microversion: 2.1 time: 0.149735 Aug 03 12:16:49.140830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 356/684] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:16:48 2022] DELETE /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:16:49.149929 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ae6c051b-842f-4836-ad55-26a257f21ebc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:49.150577 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-ae6c051b-842f-4836-ad55-26a257f21ebc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:49.156874 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ae6c051b-842f-4836-ad55-26a257f21ebc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:49.157326 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ae6c051b-842f-4836-ad55-26a257f21ebc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:49.158297 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ae6c051b-842f-4836-ad55-26a257f21ebc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:49.158921 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ae6c051b-842f-4836-ad55-26a257f21ebc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:49.445876 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ae6c051b-842f-4836-ad55-26a257f21ebc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:49.453784 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ae6c051b-842f-4836-ad55-26a257f21ebc tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1578 microversion: 2.1 time: 0.308161 Aug 03 12:16:49.454391 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 329/685] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:49 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1578 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:49.600732 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-980a7db1-16da-464e-b09f-c84ba92f18f3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:49.602187 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-980a7db1-16da-464e-b09f-c84ba92f18f3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:49.616910 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-980a7db1-16da-464e-b09f-c84ba92f18f3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:49.618213 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-980a7db1-16da-464e-b09f-c84ba92f18f3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:49.618402 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-980a7db1-16da-464e-b09f-c84ba92f18f3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:49.619722 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-980a7db1-16da-464e-b09f-c84ba92f18f3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:49.636509 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f01c75fb-1d0b-4a25-aaf1-94d9fc93df2b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:49.637622 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f01c75fb-1d0b-4a25-aaf1-94d9fc93df2b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:49.645009 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f01c75fb-1d0b-4a25-aaf1-94d9fc93df2b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:49.646244 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f01c75fb-1d0b-4a25-aaf1-94d9fc93df2b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:49.647489 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f01c75fb-1d0b-4a25-aaf1-94d9fc93df2b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:49.648106 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f01c75fb-1d0b-4a25-aaf1-94d9fc93df2b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:49.806711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-980a7db1-16da-464e-b09f-c84ba92f18f3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:49.815946 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-980a7db1-16da-464e-b09f-c84ba92f18f3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1367 microversion: 2.1 time: 0.234320 Aug 03 12:16:49.825413 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 357/686] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:49 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:49.886485 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f01c75fb-1d0b-4a25-aaf1-94d9fc93df2b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:49.896789 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f01c75fb-1d0b-4a25-aaf1-94d9fc93df2b tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.264131 Aug 03 12:16:49.897373 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 330/687] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:49 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:50.367681 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-a114776a-e1a1-4f40-824d-5ddfb42c3a13 req-c7c5ad20-9af3-4404-a19e-04b09bd1433b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad9eeba-c0de-4b84-94ca-4a6a2253ea09", "name": "network-vif-plugged", "status": "completed", "tag": "3ef595c4-cb1e-4ae4-b2b5-8ced39865114"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:50.404968 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-a114776a-e1a1-4f40-824d-5ddfb42c3a13 req-c7c5ad20-9af3-4404-a19e-04b09bd1433b service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:50.406578 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-a114776a-e1a1-4f40-824d-5ddfb42c3a13 req-c7c5ad20-9af3-4404-a19e-04b09bd1433b service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:50.452880 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-a114776a-e1a1-4f40-824d-5ddfb42c3a13 req-c7c5ad20-9af3-4404-a19e-04b09bd1433b service nova] Creating event network-vif-plugged:3ef595c4-cb1e-4ae4-b2b5-8ced39865114 for instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 on hv-cinder-83602 Aug 03 12:16:50.465504 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-a114776a-e1a1-4f40-824d-5ddfb42c3a13 req-c7c5ad20-9af3-4404-a19e-04b09bd1433b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104886 Aug 03 12:16:50.468470 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 358/688] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:50.478084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-8cf80f64-2292-41d0-a42f-3d99f18dc3c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:50.479570 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-8cf80f64-2292-41d0-a42f-3d99f18dc3c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:50.494255 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:50.495404 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=6 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:50.497619 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8cf80f64-2292-41d0-a42f-3d99f18dc3c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:50.498550 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8cf80f64-2292-41d0-a42f-3d99f18dc3c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:50.503941 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8cf80f64-2292-41d0-a42f-3d99f18dc3c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:50.504509 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8cf80f64-2292-41d0-a42f-3d99f18dc3c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:50.700229 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-8cf80f64-2292-41d0-a42f-3d99f18dc3c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:50.711773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-8cf80f64-2292-41d0-a42f-3d99f18dc3c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1578 microversion: 2.1 time: 0.238821 Aug 03 12:16:50.712988 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 331/689] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:50 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1578 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:50.835711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:50.841523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c4539b92-5341-401d-8235-f3287445187d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:50.842535 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c4539b92-5341-401d-8235-f3287445187d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:50.849621 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c4539b92-5341-401d-8235-f3287445187d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:50.850080 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c4539b92-5341-401d-8235-f3287445187d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:50.850896 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c4539b92-5341-401d-8235-f3287445187d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:50.851332 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c4539b92-5341-401d-8235-f3287445187d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:50.920134 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d0979584-9f69-4abf-946f-ca686c8f06d8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:50.920750 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d0979584-9f69-4abf-946f-ca686c8f06d8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:50.927939 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d0979584-9f69-4abf-946f-ca686c8f06d8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:50.928393 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d0979584-9f69-4abf-946f-ca686c8f06d8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:50.929190 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d0979584-9f69-4abf-946f-ca686c8f06d8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:50.929629 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d0979584-9f69-4abf-946f-ca686c8f06d8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:51.051325 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c4539b92-5341-401d-8235-f3287445187d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:51.061016 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c4539b92-5341-401d-8235-f3287445187d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1367 microversion: 2.1 time: 0.226351 Aug 03 12:16:51.061611 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 359/690] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:50 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:51.100730 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d0979584-9f69-4abf-946f-ca686c8f06d8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:51.104081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:51.108974 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d0979584-9f69-4abf-946f-ca686c8f06d8 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.192656 Aug 03 12:16:51.109561 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 332/691] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:50 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:16:51.746379 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4cc6e685-836e-4674-8804-0adc7d4b3ed5 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:51.747262 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4cc6e685-836e-4674-8804-0adc7d4b3ed5 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:51.754981 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4cc6e685-836e-4674-8804-0adc7d4b3ed5 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:51.755424 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4cc6e685-836e-4674-8804-0adc7d4b3ed5 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:51.756218 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4cc6e685-836e-4674-8804-0adc7d4b3ed5 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:51.756633 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4cc6e685-836e-4674-8804-0adc7d4b3ed5 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:51.931765 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4cc6e685-836e-4674-8804-0adc7d4b3ed5 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:51.941798 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4cc6e685-836e-4674-8804-0adc7d4b3ed5 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1578 microversion: 2.1 time: 0.199833 Aug 03 12:16:51.954481 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 360/692] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:51 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1578 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:16:52.089338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c7d016a9-a1e9-4e71-899e-ca8e1438ae5e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:52.089978 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-c7d016a9-a1e9-4e71-899e-ca8e1438ae5e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:52.098177 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c7d016a9-a1e9-4e71-899e-ca8e1438ae5e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:52.098664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c7d016a9-a1e9-4e71-899e-ca8e1438ae5e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:52.099500 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c7d016a9-a1e9-4e71-899e-ca8e1438ae5e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:52.099941 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c7d016a9-a1e9-4e71-899e-ca8e1438ae5e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:52.132894 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-79161c5c-c21c-4ca4-a941-90dcba5dd4be tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:52.133928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-79161c5c-c21c-4ca4-a941-90dcba5dd4be tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:52.144049 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-79161c5c-c21c-4ca4-a941-90dcba5dd4be tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:52.145110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-79161c5c-c21c-4ca4-a941-90dcba5dd4be tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:52.146915 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-79161c5c-c21c-4ca4-a941-90dcba5dd4be tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:52.147712 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-79161c5c-c21c-4ca4-a941-90dcba5dd4be tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:52.292347 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-c7d016a9-a1e9-4e71-899e-ca8e1438ae5e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:52.303325 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c7d016a9-a1e9-4e71-899e-ca8e1438ae5e tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1367 microversion: 2.1 time: 0.219253 Aug 03 12:16:52.304189 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 333/693] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:52 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:52.338326 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-79161c5c-c21c-4ca4-a941-90dcba5dd4be tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:52.346403 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-79161c5c-c21c-4ca4-a941-90dcba5dd4be tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1519 microversion: 2.1 time: 0.218170 Aug 03 12:16:52.347054 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 361/694] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:52 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:16:52.965356 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a0e0af8d-6917-40b1-92d5-cfc9788dd4d4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:52.965867 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a0e0af8d-6917-40b1-92d5-cfc9788dd4d4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:52.972965 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a0e0af8d-6917-40b1-92d5-cfc9788dd4d4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:52.973470 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a0e0af8d-6917-40b1-92d5-cfc9788dd4d4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:52.974964 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a0e0af8d-6917-40b1-92d5-cfc9788dd4d4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:52.975412 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a0e0af8d-6917-40b1-92d5-cfc9788dd4d4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:53.156085 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-66407c0f-6950-46c1-bdf5-c4bb03f96059 req-28afc0ac-4db5-438e-adaa-04d52e905e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dec6dd8-d607-422d-a774-65c4288a977a", "name": "network-vif-deleted", "tag": "d73c6302-a297-4802-acac-097c970a6da3"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:53.175038 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-66407c0f-6950-46c1-bdf5-c4bb03f96059 req-28afc0ac-4db5-438e-adaa-04d52e905e3e service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:53.175655 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-66407c0f-6950-46c1-bdf5-c4bb03f96059 req-28afc0ac-4db5-438e-adaa-04d52e905e3e service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:53.190600 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-66407c0f-6950-46c1-bdf5-c4bb03f96059 req-28afc0ac-4db5-438e-adaa-04d52e905e3e service nova] Creating event network-vif-deleted:d73c6302-a297-4802-acac-097c970a6da3 for instance 2dec6dd8-d607-422d-a774-65c4288a977a on hv-cinder-83602 Aug 03 12:16:53.197746 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-66407c0f-6950-46c1-bdf5-c4bb03f96059 req-28afc0ac-4db5-438e-adaa-04d52e905e3e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046415 Aug 03 12:16:53.198821 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 362/695] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:16:53.245744 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a0e0af8d-6917-40b1-92d5-cfc9788dd4d4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:53.258658 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a0e0af8d-6917-40b1-92d5-cfc9788dd4d4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1578 microversion: 2.1 time: 0.297295 Aug 03 12:16:53.259780 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 334/696] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:52 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1578 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:16:53.326175 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9399d2cc-93fe-4ca7-8d4c-7a659484cd13 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:53.326857 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9399d2cc-93fe-4ca7-8d4c-7a659484cd13 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:53.333911 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9399d2cc-93fe-4ca7-8d4c-7a659484cd13 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:53.334371 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9399d2cc-93fe-4ca7-8d4c-7a659484cd13 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:53.335357 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9399d2cc-93fe-4ca7-8d4c-7a659484cd13 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:53.335833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9399d2cc-93fe-4ca7-8d4c-7a659484cd13 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:53.378269 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5e34a1b8-3161-40f6-9211-a3e7f36ef368 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:53.379761 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5e34a1b8-3161-40f6-9211-a3e7f36ef368 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:53.393158 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e34a1b8-3161-40f6-9211-a3e7f36ef368 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:53.393602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e34a1b8-3161-40f6-9211-a3e7f36ef368 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:53.395129 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e34a1b8-3161-40f6-9211-a3e7f36ef368 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:53.395399 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5e34a1b8-3161-40f6-9211-a3e7f36ef368 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:53.516537 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5e34a1b8-3161-40f6-9211-a3e7f36ef368 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9db32ba1c4810833f8fd824536347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51be67fb4974085b55f3dcfcc2c70aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:53.546997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5e34a1b8-3161-40f6-9211-a3e7f36ef368 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 200 len: 1477 microversion: 2.1 time: 0.175418 Aug 03 12:16:53.548508 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 335/697] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:53 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 1477 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:16:53.656519 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9399d2cc-93fe-4ca7-8d4c-7a659484cd13 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:53.666837 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9399d2cc-93fe-4ca7-8d4c-7a659484cd13 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1367 microversion: 2.1 time: 0.345409 Aug 03 12:16:53.667617 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 363/698] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:53 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:16:54.297065 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-03a8bdb8-925c-40fd-9147-06ee1fa85d76 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:54.302811 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-03a8bdb8-925c-40fd-9147-06ee1fa85d76 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:54.314299 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03a8bdb8-925c-40fd-9147-06ee1fa85d76 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:54.315113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03a8bdb8-925c-40fd-9147-06ee1fa85d76 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:54.318099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03a8bdb8-925c-40fd-9147-06ee1fa85d76 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:54.319253 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-03a8bdb8-925c-40fd-9147-06ee1fa85d76 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:54.556724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-03a8bdb8-925c-40fd-9147-06ee1fa85d76 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:54.565806 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-03a8bdb8-925c-40fd-9147-06ee1fa85d76 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 200 len: 1510 microversion: 2.1 time: 0.284146 Aug 03 12:16:54.572098 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 364/699] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:54 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:54.587438 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d298f97a-b0be-4a18-baf7-b7283ee79005 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:54.590563 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d298f97a-b0be-4a18-baf7-b7283ee79005 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] [instance: 2dec6dd8-d607-422d-a774-65c4288a977a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:54.601135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d298f97a-b0be-4a18-baf7-b7283ee79005 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:54.602540 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d298f97a-b0be-4a18-baf7-b7283ee79005 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:54.605302 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d298f97a-b0be-4a18-baf7-b7283ee79005 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:54.605793 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d298f97a-b0be-4a18-baf7-b7283ee79005 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:54.622641 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-d298f97a-b0be-4a18-baf7-b7283ee79005 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] HTTP exception thrown: Instance 2dec6dd8-d607-422d-a774-65c4288a977a could not be found. Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d298f97a-b0be-4a18-baf7-b7283ee79005 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Request method failure captured: Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a HTTP/1.1 Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXpGgstOLCAy1IlP8axU4h3RqjCWiCOjN6ADxKbHRwEqWKAJbyQSVt-GY6L_iKrgzC0QBQEwSacUOcec64z9asz0SHu9FitUawVbzLJtXhCKgLQERKvuYBNI9_B_4tm1yF1ahiKM6J-qYB618EPmimAvbmvR6h-16Prn4spPy7fhlo Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: d51be67fb4974085b55f3dcfcc2c70aa Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:16:54.624420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:16:54.627044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d51be67fb4974085b55f3dcfcc2c70aa", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51be67fb4974085b55f3dcfcc2c70aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:16:54.627044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:16:54.627044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: d51be67fb4974085b55f3dcfcc2c70aa Aug 03 12:16:54.627044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-350268690 Aug 03 12:16:54.627044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-ServerRescueNegativeTestJSON-350268690-project Aug 03 12:16:54.627044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:16:54.627044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:16:54.627044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: cde9db32ba1c4810833f8fd824536347 Aug 03 12:16:54.627044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-ServerRescueNegativeTestJSON-350268690-project Aug 03 12:16:54.627044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:16:54.627044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance 2dec6dd8-d607-422d-a774-65c4288a977a could not be found. Aug 03 12:16:54.627044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': '2dec6dd8-d607-422d-a774-65c4288a977a'} Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dec6dd8-d607-422d-a774-65c4288a977a could not be found. Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:16:54.628939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dec6dd8-d607-422d-a774-65c4288a977a could not be found. Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dec6dd8-d607-422d-a774-65c4288a977a could not be found. Aug 03 12:16:54.631989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:54.634349 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d298f97a-b0be-4a18-baf7-b7283ee79005 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] Returning 404 to user: Instance 2dec6dd8-d607-422d-a774-65c4288a977a could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:16:54.634349 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d298f97a-b0be-4a18-baf7-b7283ee79005 tempest-ServerRescueNegativeTestJSON-350268690 tempest-ServerRescueNegativeTestJSON-350268690-project] 10.222.0.17 "GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a" status: 404 len: 111 microversion: 2.1 time: 0.044358 Aug 03 12:16:54.649164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 365/700] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:54 2022] GET /compute/v2.1/servers/2dec6dd8-d607-422d-a774-65c4288a977a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 12:16:54.695619 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b597d572-e435-49ee-84cd-cee41ea9dc38 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:54.696398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b597d572-e435-49ee-84cd-cee41ea9dc38 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:54.710540 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b597d572-e435-49ee-84cd-cee41ea9dc38 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:54.715566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b597d572-e435-49ee-84cd-cee41ea9dc38 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:54.716549 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b597d572-e435-49ee-84cd-cee41ea9dc38 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:54.717226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b597d572-e435-49ee-84cd-cee41ea9dc38 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:54.939020 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-a1f8e752-4aff-403c-b42f-7242f6e886c4 req-363c8bdf-72ab-48f4-b6e4-199525b236b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692c1c3e-e3b3-4d9a-ac59-e82611208c18", "name": "network-vif-deleted", "tag": "543f3e50-e8ff-49c4-bc9f-a59da69e215e"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:54.955022 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-a1f8e752-4aff-403c-b42f-7242f6e886c4 req-363c8bdf-72ab-48f4-b6e4-199525b236b0 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:54.956827 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-a1f8e752-4aff-403c-b42f-7242f6e886c4 req-363c8bdf-72ab-48f4-b6e4-199525b236b0 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:54.974686 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-a1f8e752-4aff-403c-b42f-7242f6e886c4 req-363c8bdf-72ab-48f4-b6e4-199525b236b0 service nova] Creating event network-vif-deleted:543f3e50-e8ff-49c4-bc9f-a59da69e215e for instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 on hv-cinder-83602 Aug 03 12:16:54.983203 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-a1f8e752-4aff-403c-b42f-7242f6e886c4 req-363c8bdf-72ab-48f4-b6e4-199525b236b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.722239 Aug 03 12:16:54.984259 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 336/701] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:16:55.016115 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b597d572-e435-49ee-84cd-cee41ea9dc38 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:55.024626 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b597d572-e435-49ee-84cd-cee41ea9dc38 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1557 microversion: 2.1 time: 0.338376 Aug 03 12:16:55.026503 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 366/702] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:54 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1557 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:16:55.047807 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-32007372-9311-4ecd-ad8d-67b53e2575f2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:55.048691 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-32007372-9311-4ecd-ad8d-67b53e2575f2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:55.056350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32007372-9311-4ecd-ad8d-67b53e2575f2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:55.056810 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32007372-9311-4ecd-ad8d-67b53e2575f2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:55.057839 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32007372-9311-4ecd-ad8d-67b53e2575f2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:55.058497 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32007372-9311-4ecd-ad8d-67b53e2575f2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:55.188458 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-32007372-9311-4ecd-ad8d-67b53e2575f2 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145055 Aug 03 12:16:55.189580 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 337/703] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 3 12:16:55 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:16:55.593322 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e3a04ada-c3ac-42d9-bcf4-de446690f890 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:55.595391 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e3a04ada-c3ac-42d9-bcf4-de446690f890 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:55.603787 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e3a04ada-c3ac-42d9-bcf4-de446690f890 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:55.604520 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e3a04ada-c3ac-42d9-bcf4-de446690f890 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:55.605676 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e3a04ada-c3ac-42d9-bcf4-de446690f890 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:55.606305 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e3a04ada-c3ac-42d9-bcf4-de446690f890 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:55.621591 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-e3a04ada-c3ac-42d9-bcf4-de446690f890 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] HTTP exception thrown: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e3a04ada-c3ac-42d9-bcf4-de446690f890 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Request method failure captured: Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 HTTP/1.1 Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mZbPbLQhVad68K-n9zaoY5chdtsAMQEyuzcD-d8_vNECRY1Yew1oxlQ0mmLvBmzmAEwX-nEIm95seUV4qJ-IWKx-20BNQvNgZjRI6E_jXNyucpaFd16g9X_GxrFH6AEN7ipWQcmhSL3HvvK_338KhIq1WOPco2Y-gDl_bVLDbD43ew Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 1a4c09dba5b24ef5b37b730b259d3790 Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-TestVolumeBootPattern-635734442 Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:16:55.623221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:16:55.624744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a4c09dba5b24ef5b37b730b259d3790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:16:55.624744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-TestVolumeBootPattern-635734442 Aug 03 12:16:55.624744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 1a4c09dba5b24ef5b37b730b259d3790 Aug 03 12:16:55.624744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-TestVolumeBootPattern-635734442 Aug 03 12:16:55.624744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-TestVolumeBootPattern-635734442-project Aug 03 12:16:55.624744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:16:55.624744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:16:55.624744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 5cf524f6288040219c0492d3a794e830 Aug 03 12:16:55.624744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-TestVolumeBootPattern-635734442-project Aug 03 12:16:55.624744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:16:55.624744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:16:55.624744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': '692c1c3e-e3b3-4d9a-ac59-e82611208c18'} Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:16:55.625656 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:16:55.627099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:16:55.629694 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e3a04ada-c3ac-42d9-bcf4-de446690f890 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Returning 404 to user: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:16:55.631185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e3a04ada-c3ac-42d9-bcf4-de446690f890 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 404 len: 111 microversion: 2.1 time: 0.041811 Aug 03 12:16:55.632049 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 367/704] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:55 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 12:16:55.756589 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1643075158", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1695578460", "security_groups": [{"name": "tempest-secgroup-smoke-1652712651"}], "block_device_mapping_v2": [{"uuid": "b9787886-4451-4c89-99b6-8822a819e961", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a7bb6085-454f-4cb3-bcae-1c152bc4a607"}]}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:55.994919 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.network.neutron [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] validate_networks() for [('a7bb6085-454f-4cb3-bcae-1c152bc4a607', None, None, None, None, None)] {{(pid=117911) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:16:56.740859 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-915a8aae-43db-4ffc-8424-34903fffa02a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:56.742909 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-915a8aae-43db-4ffc-8424-34903fffa02a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:56.758263 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-915a8aae-43db-4ffc-8424-34903fffa02a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:56.759850 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-915a8aae-43db-4ffc-8424-34903fffa02a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:56.762987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-915a8aae-43db-4ffc-8424-34903fffa02a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:56.764455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-915a8aae-43db-4ffc-8424-34903fffa02a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:56.832234 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-915a8aae-43db-4ffc-8424-34903fffa02a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/ips" status: 200 len: 152 microversion: 2.20 time: 0.345556 Aug 03 12:16:56.835164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 368/705] 10.222.0.17 () {60 vars in 1289 bytes} [Wed Aug 3 12:16:56 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/ips => generated 152 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:16:57.089244 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-9e6d2bf1-2fb2-46c6-8976-4c7f4896af30 req-71c6cc8f-ffa6-455f-b05f-7f20766361de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad9eeba-c0de-4b84-94ca-4a6a2253ea09", "tag": "3ef595c4-cb1e-4ae4-b2b5-8ced39865114"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:57.111260 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-9e6d2bf1-2fb2-46c6-8976-4c7f4896af30 req-71c6cc8f-ffa6-455f-b05f-7f20766361de service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:57.111712 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-9e6d2bf1-2fb2-46c6-8976-4c7f4896af30 req-71c6cc8f-ffa6-455f-b05f-7f20766361de service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:57.129315 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:16:57.132521 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-9e6d2bf1-2fb2-46c6-8976-4c7f4896af30 req-71c6cc8f-ffa6-455f-b05f-7f20766361de service nova] Creating event network-changed:3ef595c4-cb1e-4ae4-b2b5-8ced39865114 for instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 on hv-cinder-83602 Aug 03 12:16:57.142051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Flavor limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:16:57.143829 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Image limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:16:57.144966 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Flavor pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:16:57.145894 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Image pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:16:57.146100 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:16:57.154960 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-9e6d2bf1-2fb2-46c6-8976-4c7f4896af30 req-71c6cc8f-ffa6-455f-b05f-7f20766361de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069396 Aug 03 12:16:57.156963 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 369/706] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:16:57.162283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:57.162885 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:57.164204 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:57.164578 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:57.196642 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Getting quotas for project 1a4c09dba5b24ef5b37b730b259d3790. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:16:57.204832 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Getting quotas for user 5cf524f6288040219c0492d3a794e830 and project 1a4c09dba5b24ef5b37b730b259d3790. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:16:57.317098 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Going to run 1 instances... {{(pid=117911) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:16:57.320822 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9787886-4451-4c89-99b6-8822a819e961',volume_size=None,volume_type=None)] {{(pid=117911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:16:57.590809 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-4a479a76-2cca-47ab-b9a3-f6c984a8db5e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.839608 Aug 03 12:16:57.597527 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 338/707] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:16:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:16:57.610552 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-af1515fe-3aa4-4670-aec9-0feb1c9b405e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:57.611173 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-af1515fe-3aa4-4670-aec9-0feb1c9b405e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:57.779791 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-af1515fe-3aa4-4670-aec9-0feb1c9b405e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:57.793749 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-af1515fe-3aa4-4670-aec9-0feb1c9b405e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1095 microversion: 2.1 time: 0.188014 Aug 03 12:16:57.794711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 370/708] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:57 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1095 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:58.819769 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3c168fbd-79cb-4d99-9f19-9586ccb305b7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:58.821790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-3c168fbd-79cb-4d99-9f19-9586ccb305b7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:58.830761 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3c168fbd-79cb-4d99-9f19-9586ccb305b7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:58.831605 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3c168fbd-79cb-4d99-9f19-9586ccb305b7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:58.832622 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3c168fbd-79cb-4d99-9f19-9586ccb305b7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:58.833327 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3c168fbd-79cb-4d99-9f19-9586ccb305b7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:58.927322 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-00140c11-8046-4121-80a3-a487ff1c6cfd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:16:58.927933 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-00140c11-8046-4121-80a3-a487ff1c6cfd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:58.947551 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-00140c11-8046-4121-80a3-a487ff1c6cfd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:58.948011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-00140c11-8046-4121-80a3-a487ff1c6cfd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:58.948802 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-00140c11-8046-4121-80a3-a487ff1c6cfd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:58.949240 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-00140c11-8046-4121-80a3-a487ff1c6cfd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:58.979179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-00140c11-8046-4121-80a3-a487ff1c6cfd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lazy-loading 'flavor' on Instance uuid f5335f69-42aa-4fcf-8ee9-223f8e1485ec {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:16:58.979707 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-3c168fbd-79cb-4d99-9f19-9586ccb305b7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:58.998232 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-3c168fbd-79cb-4d99-9f19-9586ccb305b7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1193 microversion: 2.1 time: 0.183373 Aug 03 12:16:59.005418 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 339/709] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:16:58 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1193 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:16:59.332262 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-00140c11-8046-4121-80a3-a487ff1c6cfd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "POST /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/action" status: 202 len: 0 microversion: 2.20 time: 0.408829 Aug 03 12:16:59.342863 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2468460a-58dc-4f9f-aeab-f4233beba4ac tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:16:59.343857 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2468460a-58dc-4f9f-aeab-f4233beba4ac tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:16:59.351307 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 371/710] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Aug 3 12:16:58 2022] POST /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:16:59.353686 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2468460a-58dc-4f9f-aeab-f4233beba4ac tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:59.354139 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2468460a-58dc-4f9f-aeab-f4233beba4ac tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:59.355001 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2468460a-58dc-4f9f-aeab-f4233beba4ac tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:16:59.355438 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2468460a-58dc-4f9f-aeab-f4233beba4ac tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:16:59.861132 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2468460a-58dc-4f9f-aeab-f4233beba4ac tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:59.877340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2468460a-58dc-4f9f-aeab-f4233beba4ac tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:59.879299 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2468460a-58dc-4f9f-aeab-f4233beba4ac tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:16:59.881230 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2468460a-58dc-4f9f-aeab-f4233beba4ac tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.542428 Aug 03 12:16:59.882068 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 340/711] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:16:59 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:17:00.044101 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3165386d-c2de-4fad-b175-914f026f612c tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:00.044827 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3165386d-c2de-4fad-b175-914f026f612c tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:00.068995 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3165386d-c2de-4fad-b175-914f026f612c tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:00.069558 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3165386d-c2de-4fad-b175-914f026f612c tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:00.070494 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3165386d-c2de-4fad-b175-914f026f612c tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:00.070946 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3165386d-c2de-4fad-b175-914f026f612c tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:00.256164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3165386d-c2de-4fad-b175-914f026f612c tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:00.264050 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3165386d-c2de-4fad-b175-914f026f612c tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1199 microversion: 2.1 time: 0.224871 Aug 03 12:17:00.264564 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 372/712] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:00 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1199 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:00.580291 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-edc6472a-9c04-4bc1-9a4e-7984b79897d5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:00.583841 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-edc6472a-9c04-4bc1-9a4e-7984b79897d5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:00.598582 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-edc6472a-9c04-4bc1-9a4e-7984b79897d5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:00.598582 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-edc6472a-9c04-4bc1-9a4e-7984b79897d5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:00.598582 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-edc6472a-9c04-4bc1-9a4e-7984b79897d5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:00.598582 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-edc6472a-9c04-4bc1-9a4e-7984b79897d5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:00.654923 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-edc6472a-9c04-4bc1-9a4e-7984b79897d5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080266 Aug 03 12:17:00.657222 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 341/713] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:17:00 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 12:17:00.750402 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2eeba4a7-eb1d-4c5d-a7d4-d44fef9c2838 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:00.751495 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2eeba4a7-eb1d-4c5d-a7d4-d44fef9c2838 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:00.760317 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2eeba4a7-eb1d-4c5d-a7d4-d44fef9c2838 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:00.761144 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2eeba4a7-eb1d-4c5d-a7d4-d44fef9c2838 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:00.763545 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2eeba4a7-eb1d-4c5d-a7d4-d44fef9c2838 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:00.764255 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2eeba4a7-eb1d-4c5d-a7d4-d44fef9c2838 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:00.811596 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2eeba4a7-eb1d-4c5d-a7d4-d44fef9c2838 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:17:00.918051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-92cace32-e234-45e7-abd9-3fa24f995462 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:00.919280 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-92cace32-e234-45e7-abd9-3fa24f995462 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:00.930253 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-92cace32-e234-45e7-abd9-3fa24f995462 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:00.931256 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-92cace32-e234-45e7-abd9-3fa24f995462 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:00.932806 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-92cace32-e234-45e7-abd9-3fa24f995462 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:00.933628 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-92cace32-e234-45e7-abd9-3fa24f995462 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:00.992971 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2eeba4a7-eb1d-4c5d-a7d4-d44fef9c2838 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 204 len: 0 microversion: 2.1 time: 0.247020 Aug 03 12:17:00.994647 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 373/714] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:17:00 2022] DELETE /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:17:01.007180 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-83c88d54-476a-4826-a8ae-827b7d4ed1b7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:01.008879 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-83c88d54-476a-4826-a8ae-827b7d4ed1b7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:01.023249 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-83c88d54-476a-4826-a8ae-827b7d4ed1b7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:01.024484 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-83c88d54-476a-4826-a8ae-827b7d4ed1b7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:01.026542 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-83c88d54-476a-4826-a8ae-827b7d4ed1b7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:01.027379 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-83c88d54-476a-4826-a8ae-827b7d4ed1b7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:01.151648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-92cace32-e234-45e7-abd9-3fa24f995462 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:01.161072 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-92cace32-e234-45e7-abd9-3fa24f995462 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:01.163727 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-92cace32-e234-45e7-abd9-3fa24f995462 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:01.165175 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-92cace32-e234-45e7-abd9-3fa24f995462 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.252851 Aug 03 12:17:01.166022 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 342/715] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:00 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:01.289538 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2dde2f72-bef9-4929-a715-ccf762eda261 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:01.290704 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2dde2f72-bef9-4929-a715-ccf762eda261 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:01.297957 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2dde2f72-bef9-4929-a715-ccf762eda261 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:01.298452 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2dde2f72-bef9-4929-a715-ccf762eda261 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:01.299254 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2dde2f72-bef9-4929-a715-ccf762eda261 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:01.299698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2dde2f72-bef9-4929-a715-ccf762eda261 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:01.405391 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-83c88d54-476a-4826-a8ae-827b7d4ed1b7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:01.417223 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-83c88d54-476a-4826-a8ae-827b7d4ed1b7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1671 microversion: 2.1 time: 0.416540 Aug 03 12:17:01.417833 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 374/716] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:00 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1671 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:01.486712 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2dde2f72-bef9-4929-a715-ccf762eda261 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:01.497268 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2dde2f72-bef9-4929-a715-ccf762eda261 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1267 microversion: 2.1 time: 0.212910 Aug 03 12:17:01.497867 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 343/717] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:01 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:17:02.102165 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-ab2153e5-0f4a-4991-ab73-2f65b493ac7d req-ab5332df-1f45-427f-8e59-71bcc80e229e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df1f8fb-2c96-4ef7-98ce-8df409fa3054", "tag": "8da85e18-cee2-4903-a631-2f87bee7cafb"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:02.112639 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-ab2153e5-0f4a-4991-ab73-2f65b493ac7d req-ab5332df-1f45-427f-8e59-71bcc80e229e service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:02.113076 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-ab2153e5-0f4a-4991-ab73-2f65b493ac7d req-ab5332df-1f45-427f-8e59-71bcc80e229e service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:02.126208 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-ab2153e5-0f4a-4991-ab73-2f65b493ac7d req-ab5332df-1f45-427f-8e59-71bcc80e229e service nova] Creating event network-changed:8da85e18-cee2-4903-a631-2f87bee7cafb for instance 4df1f8fb-2c96-4ef7-98ce-8df409fa3054 on hv-cinder-83602 Aug 03 12:17:02.132137 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-ab2153e5-0f4a-4991-ab73-2f65b493ac7d req-ab5332df-1f45-427f-8e59-71bcc80e229e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036059 Aug 03 12:17:02.132748 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 375/718] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:17:02.190070 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-df1d392d-3586-4e9a-9c7e-9a4d15efc842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:02.190878 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-df1d392d-3586-4e9a-9c7e-9a4d15efc842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:02.199112 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-df1d392d-3586-4e9a-9c7e-9a4d15efc842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:02.199552 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-df1d392d-3586-4e9a-9c7e-9a4d15efc842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:02.200698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-df1d392d-3586-4e9a-9c7e-9a4d15efc842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:02.201450 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-df1d392d-3586-4e9a-9c7e-9a4d15efc842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:02.360206 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-df1d392d-3586-4e9a-9c7e-9a4d15efc842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:02.373081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-df1d392d-3586-4e9a-9c7e-9a4d15efc842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:02.375009 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-df1d392d-3586-4e9a-9c7e-9a4d15efc842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:02.376430 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-df1d392d-3586-4e9a-9c7e-9a4d15efc842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.190776 Aug 03 12:17:02.377386 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 344/719] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:02 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:02.441365 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e48a89ea-0bb7-443d-aae3-b0a3c2566213 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:02.442155 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e48a89ea-0bb7-443d-aae3-b0a3c2566213 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:02.449474 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e48a89ea-0bb7-443d-aae3-b0a3c2566213 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:02.449931 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e48a89ea-0bb7-443d-aae3-b0a3c2566213 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:02.450775 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e48a89ea-0bb7-443d-aae3-b0a3c2566213 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:02.451230 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e48a89ea-0bb7-443d-aae3-b0a3c2566213 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:02.521645 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-73d04158-9d41-4a89-bdca-2ed9fe328816 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:02.522264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-73d04158-9d41-4a89-bdca-2ed9fe328816 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:02.529235 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-73d04158-9d41-4a89-bdca-2ed9fe328816 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:02.529696 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-73d04158-9d41-4a89-bdca-2ed9fe328816 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:02.530559 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-73d04158-9d41-4a89-bdca-2ed9fe328816 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:02.531290 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-73d04158-9d41-4a89-bdca-2ed9fe328816 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:02.654858 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e48a89ea-0bb7-443d-aae3-b0a3c2566213 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:02.667668 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e48a89ea-0bb7-443d-aae3-b0a3c2566213 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1671 microversion: 2.1 time: 0.231072 Aug 03 12:17:02.669793 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 376/720] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:02 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1671 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:17:02.732389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-73d04158-9d41-4a89-bdca-2ed9fe328816 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:02.745684 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-73d04158-9d41-4a89-bdca-2ed9fe328816 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1267 microversion: 2.1 time: 0.228227 Aug 03 12:17:02.746297 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 345/721] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:02 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:17:03.405149 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f4062c6c-b0ae-460f-a5e9-d9725468bb48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:03.406435 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f4062c6c-b0ae-460f-a5e9-d9725468bb48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:03.419871 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f4062c6c-b0ae-460f-a5e9-d9725468bb48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:03.421162 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f4062c6c-b0ae-460f-a5e9-d9725468bb48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:03.423006 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f4062c6c-b0ae-460f-a5e9-d9725468bb48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:03.424218 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f4062c6c-b0ae-460f-a5e9-d9725468bb48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:03.718905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f4062c6c-b0ae-460f-a5e9-d9725468bb48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:03.726668 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-18d86612-eac7-424d-aeb9-f5aae826344b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:03.730096 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-18d86612-eac7-424d-aeb9-f5aae826344b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:03.762912 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f4062c6c-b0ae-460f-a5e9-d9725468bb48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:03.769913 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-18d86612-eac7-424d-aeb9-f5aae826344b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:03.771480 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-18d86612-eac7-424d-aeb9-f5aae826344b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:03.775997 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f4062c6c-b0ae-460f-a5e9-d9725468bb48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:03.777250 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f4062c6c-b0ae-460f-a5e9-d9725468bb48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.379416 Aug 03 12:17:03.779024 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-18d86612-eac7-424d-aeb9-f5aae826344b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:03.779480 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-18d86612-eac7-424d-aeb9-f5aae826344b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:03.783932 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 377/722] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:03 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:03.790624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-30d8a747-a7b1-44f1-bd02-4cf915c75979 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:03.791266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-30d8a747-a7b1-44f1-bd02-4cf915c75979 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:03.805492 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-30d8a747-a7b1-44f1-bd02-4cf915c75979 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:03.806563 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-30d8a747-a7b1-44f1-bd02-4cf915c75979 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:03.809038 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-30d8a747-a7b1-44f1-bd02-4cf915c75979 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:03.809910 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-30d8a747-a7b1-44f1-bd02-4cf915c75979 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:04.030202 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-30d8a747-a7b1-44f1-bd02-4cf915c75979 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:04.044589 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-30d8a747-a7b1-44f1-bd02-4cf915c75979 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1267 microversion: 2.1 time: 0.258107 Aug 03 12:17:04.046041 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 378/723] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:03 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:04.235315 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-18d86612-eac7-424d-aeb9-f5aae826344b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:04.249356 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-18d86612-eac7-424d-aeb9-f5aae826344b tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 200 len: 1603 microversion: 2.1 time: 0.547567 Aug 03 12:17:04.250372 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 346/724] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:03 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 1603 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:04.524146 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-8dbf5412-c7b5-47eb-b13d-2f84626e2f93 req-ec31a14b-d81f-4e4b-a1c2-df0a5bca93f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed09302a-b62b-4353-976f-e47444e0dda4", "name": "network-vif-deleted", "tag": "81055a13-727c-42c8-b797-93ca848ece8c"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:04.539309 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-8dbf5412-c7b5-47eb-b13d-2f84626e2f93 req-ec31a14b-d81f-4e4b-a1c2-df0a5bca93f2 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:04.539957 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-8dbf5412-c7b5-47eb-b13d-2f84626e2f93 req-ec31a14b-d81f-4e4b-a1c2-df0a5bca93f2 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:04.552919 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-8dbf5412-c7b5-47eb-b13d-2f84626e2f93 req-ec31a14b-d81f-4e4b-a1c2-df0a5bca93f2 service nova] Creating event network-vif-deleted:81055a13-727c-42c8-b797-93ca848ece8c for instance ed09302a-b62b-4353-976f-e47444e0dda4 on hv-cinder-83602 Aug 03 12:17:04.558675 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-8dbf5412-c7b5-47eb-b13d-2f84626e2f93 req-ec31a14b-d81f-4e4b-a1c2-df0a5bca93f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043129 Aug 03 12:17:04.559678 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 379/725] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:17:04.805194 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-72f1dd82-2ae3-4111-9962-26b6f1cdbc1c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:04.806368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-72f1dd82-2ae3-4111-9962-26b6f1cdbc1c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:04.815044 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-72f1dd82-2ae3-4111-9962-26b6f1cdbc1c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:04.815490 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-72f1dd82-2ae3-4111-9962-26b6f1cdbc1c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:04.816495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-72f1dd82-2ae3-4111-9962-26b6f1cdbc1c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:04.816943 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-72f1dd82-2ae3-4111-9962-26b6f1cdbc1c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:04.999556 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-72f1dd82-2ae3-4111-9962-26b6f1cdbc1c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:05.013815 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-72f1dd82-2ae3-4111-9962-26b6f1cdbc1c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:05.017034 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-72f1dd82-2ae3-4111-9962-26b6f1cdbc1c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:05.018859 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-72f1dd82-2ae3-4111-9962-26b6f1cdbc1c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.218050 Aug 03 12:17:05.020079 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 347/726] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:04 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:17:05.071253 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a2635fb6-3b00-4f1f-96e3-22355edaeaea tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:05.072325 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a2635fb6-3b00-4f1f-96e3-22355edaeaea tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:05.081629 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a2635fb6-3b00-4f1f-96e3-22355edaeaea tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:05.082180 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a2635fb6-3b00-4f1f-96e3-22355edaeaea tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:05.083687 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a2635fb6-3b00-4f1f-96e3-22355edaeaea tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:05.085003 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a2635fb6-3b00-4f1f-96e3-22355edaeaea tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:05.260621 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a2635fb6-3b00-4f1f-96e3-22355edaeaea tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:05.274222 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e541dc18-6cd0-452d-97fc-bd8ccb61933f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:05.275145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e541dc18-6cd0-452d-97fc-bd8ccb61933f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:05.283328 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e541dc18-6cd0-452d-97fc-bd8ccb61933f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:05.284132 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e541dc18-6cd0-452d-97fc-bd8ccb61933f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:05.285549 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e541dc18-6cd0-452d-97fc-bd8ccb61933f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:05.286194 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e541dc18-6cd0-452d-97fc-bd8ccb61933f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:05.292222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a2635fb6-3b00-4f1f-96e3-22355edaeaea tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1267 microversion: 2.1 time: 0.226986 Aug 03 12:17:05.293080 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 380/727] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:05 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:17:05.300916 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-e541dc18-6cd0-452d-97fc-bd8ccb61933f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] HTTP exception thrown: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e541dc18-6cd0-452d-97fc-bd8ccb61933f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Request method failure captured: Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 HTTP/1.1 Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mZEJTKvPklrABZ86b2SLk-cx3F8bCfPt3_GFZlVL42AGO1mX3IbPa3KVw_Eie_jMpgAuscZhZ7MJ519e3rKjKe8j1ROLyT-jk0JA4Xjf4627c8epFqHsm4LouvB5LVnNb5_kec_0vgWUhLbLiFNzWTWfikwpsNRFifyz_VAJ0oHZLQ Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 8bf1655c29144bb2a7d925a5a5b22bdb Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:17:05.303647 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:17:05.305027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8bf1655c29144bb2a7d925a5a5b22bdb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:17:05.305027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:17:05.305027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 8bf1655c29144bb2a7d925a5a5b22bdb Aug 03 12:17:05.305027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:17:05.305027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-AttachVolumeTestJSON-1103562566-project Aug 03 12:17:05.305027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:17:05.305027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:17:05.305027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 023c699e0cac426f8e7229ebbb7727b7 Aug 03 12:17:05.305027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-AttachVolumeTestJSON-1103562566-project Aug 03 12:17:05.305027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:17:05.305027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:17:05.305027 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'ed09302a-b62b-4353-976f-e47444e0dda4'} Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:17:05.305824 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:17:05.307081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:05.309200 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e541dc18-6cd0-452d-97fc-bd8ccb61933f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Returning 404 to user: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:17:05.310120 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e541dc18-6cd0-452d-97fc-bd8ccb61933f tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 404 len: 111 microversion: 2.1 time: 0.041960 Aug 03 12:17:05.310748 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 348/728] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:05 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:17:05.319852 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1f19ef24-3a18-4507-b788-eedbf8f41d93 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '.version_select at 0x7f14dc033790>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:05.329258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=4 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:05.350117 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1f19ef24-3a18-4507-b788-eedbf8f41d93 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-974631001" status: 202 len: 0 microversion: 2.1 time: 0.034185 Aug 03 12:17:05.351223 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 381/729] 10.222.0.17 () {58 vars in 1218 bytes} [Wed Aug 3 12:17:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-974631001 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:17:06.047640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7743a5b7-99f2-4819-9509-bb0f1f47096a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:06.049043 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7743a5b7-99f2-4819-9509-bb0f1f47096a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:06.056503 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7743a5b7-99f2-4819-9509-bb0f1f47096a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:06.056949 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7743a5b7-99f2-4819-9509-bb0f1f47096a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:06.057742 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7743a5b7-99f2-4819-9509-bb0f1f47096a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:06.058594 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7743a5b7-99f2-4819-9509-bb0f1f47096a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:06.322155 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a400a450-f331-494d-b523-b0b7c89ad6a3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:06.322807 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a400a450-f331-494d-b523-b0b7c89ad6a3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:06.333312 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a400a450-f331-494d-b523-b0b7c89ad6a3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:06.334038 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a400a450-f331-494d-b523-b0b7c89ad6a3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:06.335022 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a400a450-f331-494d-b523-b0b7c89ad6a3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:06.335611 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a400a450-f331-494d-b523-b0b7c89ad6a3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:06.357673 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7743a5b7-99f2-4819-9509-bb0f1f47096a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:06.371075 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7743a5b7-99f2-4819-9509-bb0f1f47096a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:06.373566 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7743a5b7-99f2-4819-9509-bb0f1f47096a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:06.375090 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7743a5b7-99f2-4819-9509-bb0f1f47096a tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.333060 Aug 03 12:17:06.375998 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 349/730] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:06 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:06.413303 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-aaa50ec5-ae03-46f4-8060-d40bb99e9d42 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Action: 'create', calling method: .version_select at 0x7f14d6da3430>, body: {"keypair": {"name": "tempest-keypair-1605398985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX0VjxwD/vzKG4ujtkhIyFmBkj4h3f5zAlDv7VsfhWlh53xhr8o0cKmfDv02cq3nNRSCHOxKkSWAkrHjNJmAOiOHKsaFIKbYgGxYDl2vMTjiranpl3M6P+YIsJ51exYWQ=="}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:06.433133 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-aaa50ec5-ae03-46f4-8060-d40bb99e9d42 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Getting quotas for project 8bf1655c29144bb2a7d925a5a5b22bdb. Resources: {'key_pairs'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:17:06.439727 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-aaa50ec5-ae03-46f4-8060-d40bb99e9d42 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Getting quotas for user 023c699e0cac426f8e7229ebbb7727b7 and project 8bf1655c29144bb2a7d925a5a5b22bdb. Resources: {'key_pairs'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:17:06.477178 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-aaa50ec5-ae03-46f4-8060-d40bb99e9d42 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068031 Aug 03 12:17:06.477805 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 350/731] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 3 12:17:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:17:06.584127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a400a450-f331-494d-b523-b0b7c89ad6a3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:06.599853 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a400a450-f331-494d-b523-b0b7c89ad6a3 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1267 microversion: 2.1 time: 0.282417 Aug 03 12:17:06.601262 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 382/732] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:06 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1267 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:17:07.405007 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-380fd20d-abdb-4724-80f9-fad2af07f520 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:07.407270 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-380fd20d-abdb-4724-80f9-fad2af07f520 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:07.413311 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:07.425206 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-380fd20d-abdb-4724-80f9-fad2af07f520 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:07.426784 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-380fd20d-abdb-4724-80f9-fad2af07f520 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:07.428562 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-380fd20d-abdb-4724-80f9-fad2af07f520 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:07.429616 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-380fd20d-abdb-4724-80f9-fad2af07f520 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:07.631404 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-02268040-2a9d-41ad-982f-c78fddd114d9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:07.634292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-02268040-2a9d-41ad-982f-c78fddd114d9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:07.649500 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-02268040-2a9d-41ad-982f-c78fddd114d9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:07.651908 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-02268040-2a9d-41ad-982f-c78fddd114d9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:07.653159 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-02268040-2a9d-41ad-982f-c78fddd114d9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:07.653958 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-02268040-2a9d-41ad-982f-c78fddd114d9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:07.722993 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-380fd20d-abdb-4724-80f9-fad2af07f520 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:07.737848 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-380fd20d-abdb-4724-80f9-fad2af07f520 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:07.739963 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-380fd20d-abdb-4724-80f9-fad2af07f520 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:07.741275 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-380fd20d-abdb-4724-80f9-fad2af07f520 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.343793 Aug 03 12:17:07.754968 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 351/733] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:07 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:07.793744 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:07.839146 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-02268040-2a9d-41ad-982f-c78fddd114d9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:07.848468 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-02268040-2a9d-41ad-982f-c78fddd114d9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1267 microversion: 2.1 time: 0.227828 Aug 03 12:17:07.849074 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 383/734] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:07 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:08.271389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1453672494", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b75cfbf7-4349-4c9b-8bc5-90bc1a193e08"}], "security_groups": [{"name": "tempest-securitygroup--1238104616"}], "key_name": "tempest-keypair-1605398985", "user_data": "}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:08.405735 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.network.neutron [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] validate_networks() for [('b75cfbf7-4349-4c9b-8bc5-90bc1a193e08', None, None, None, None, None)] {{(pid=117911) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:17:08.766198 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-307718bf-115f-4127-a076-cf262cd561b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:08.766859 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-307718bf-115f-4127-a076-cf262cd561b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:08.779821 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-307718bf-115f-4127-a076-cf262cd561b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:08.780326 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-307718bf-115f-4127-a076-cf262cd561b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:08.781319 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-307718bf-115f-4127-a076-cf262cd561b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:08.782163 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-307718bf-115f-4127-a076-cf262cd561b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:08.893836 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Flavor limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:17:08.894894 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Image limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:17:08.895768 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Flavor pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:17:08.896513 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Image pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:17:08.897311 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:17:08.911669 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:08.912862 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:08.914747 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:08.915770 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:08.943297 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Getting quotas for project 8bf1655c29144bb2a7d925a5a5b22bdb. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:17:08.949929 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Getting quotas for user 023c699e0cac426f8e7229ebbb7727b7 and project 8bf1655c29144bb2a7d925a5a5b22bdb. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:17:08.966376 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Going to run 1 instances... {{(pid=117911) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:17:08.968572 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:17:09.003164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-307718bf-115f-4127-a076-cf262cd561b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:09.019453 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-307718bf-115f-4127-a076-cf262cd561b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:09.022370 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-307718bf-115f-4127-a076-cf262cd561b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:09.024300 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-307718bf-115f-4127-a076-cf262cd561b2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.262790 Aug 03 12:17:09.025238 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 384/735] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:08 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:17:09.030202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b52f6d62-75dc-4d7d-95f5-24ea5e3944bf tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.765198 Aug 03 12:17:09.033283 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-07da18c9-aa72-46cc-9800-9f853c8163a9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:09.034159 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-07da18c9-aa72-46cc-9800-9f853c8163a9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:09.037690 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 352/736] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:17:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:17:09.043292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2d3c0421-fdc9-4e89-b140-8c8f66e0e75d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:09.043983 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2d3c0421-fdc9-4e89-b140-8c8f66e0e75d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:09.062694 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-07da18c9-aa72-46cc-9800-9f853c8163a9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:09.066648 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-07da18c9-aa72-46cc-9800-9f853c8163a9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:09.068841 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-07da18c9-aa72-46cc-9800-9f853c8163a9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:09.069390 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-07da18c9-aa72-46cc-9800-9f853c8163a9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:09.121928 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2d3c0421-fdc9-4e89-b140-8c8f66e0e75d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:09.132256 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2d3c0421-fdc9-4e89-b140-8c8f66e0e75d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1238 microversion: 2.1 time: 0.093033 Aug 03 12:17:09.133260 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 353/737] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:09 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:09.304287 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-07da18c9-aa72-46cc-9800-9f853c8163a9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:09.312401 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-07da18c9-aa72-46cc-9800-9f853c8163a9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1267 microversion: 2.1 time: 0.285712 Aug 03 12:17:09.326547 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 385/738] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:09 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:10.054343 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-999b48d6-7723-4675-a47e-89e0430ae529 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:10.056145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-999b48d6-7723-4675-a47e-89e0430ae529 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:10.059009 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:10.069509 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-999b48d6-7723-4675-a47e-89e0430ae529 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:10.070592 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-999b48d6-7723-4675-a47e-89e0430ae529 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:10.071658 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-999b48d6-7723-4675-a47e-89e0430ae529 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:10.072349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-999b48d6-7723-4675-a47e-89e0430ae529 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:10.106061 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=100 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:10.155226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d47923ea-db9b-4c3d-ba4d-6b1894ab3f1e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:10.156040 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d47923ea-db9b-4c3d-ba4d-6b1894ab3f1e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:10.169918 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d47923ea-db9b-4c3d-ba4d-6b1894ab3f1e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:10.170413 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d47923ea-db9b-4c3d-ba4d-6b1894ab3f1e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:10.171376 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d47923ea-db9b-4c3d-ba4d-6b1894ab3f1e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:10.172098 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d47923ea-db9b-4c3d-ba4d-6b1894ab3f1e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:10.175828 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:10.309932 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d47923ea-db9b-4c3d-ba4d-6b1894ab3f1e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:10.321241 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-999b48d6-7723-4675-a47e-89e0430ae529 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:10.326932 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d47923ea-db9b-4c3d-ba4d-6b1894ab3f1e tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1290 microversion: 2.1 time: 0.174212 Aug 03 12:17:10.328394 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 386/739] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:10 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1290 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:17:10.337970 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c0f6a0a8-166d-40c2-b88a-4888d0e2812f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:10.341520 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c0f6a0a8-166d-40c2-b88a-4888d0e2812f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:10.344707 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-999b48d6-7723-4675-a47e-89e0430ae529 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:10.346519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-999b48d6-7723-4675-a47e-89e0430ae529 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:10.348028 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-999b48d6-7723-4675-a47e-89e0430ae529 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.301755 Aug 03 12:17:10.349439 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 354/740] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:10 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:10.378217 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c0f6a0a8-166d-40c2-b88a-4888d0e2812f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:10.382940 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c0f6a0a8-166d-40c2-b88a-4888d0e2812f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:10.385551 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c0f6a0a8-166d-40c2-b88a-4888d0e2812f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:10.392475 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c0f6a0a8-166d-40c2-b88a-4888d0e2812f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:10.635737 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c0f6a0a8-166d-40c2-b88a-4888d0e2812f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:10.650244 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c0f6a0a8-166d-40c2-b88a-4888d0e2812f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1267 microversion: 2.1 time: 0.319858 Aug 03 12:17:10.651328 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 387/741] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:10 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:11.349214 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-49f563c6-c19c-4d82-8fb4-a50610b20843 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:11.349940 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-49f563c6-c19c-4d82-8fb4-a50610b20843 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:11.360530 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-49f563c6-c19c-4d82-8fb4-a50610b20843 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:11.361376 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-49f563c6-c19c-4d82-8fb4-a50610b20843 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:11.363051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-49f563c6-c19c-4d82-8fb4-a50610b20843 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:11.364434 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-49f563c6-c19c-4d82-8fb4-a50610b20843 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:11.382350 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c9eae44a-067c-464c-b30c-622ac7a45e51 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:11.385261 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c9eae44a-067c-464c-b30c-622ac7a45e51 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:11.421384 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9eae44a-067c-464c-b30c-622ac7a45e51 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:11.422428 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9eae44a-067c-464c-b30c-622ac7a45e51 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:11.424808 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9eae44a-067c-464c-b30c-622ac7a45e51 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:11.425560 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c9eae44a-067c-464c-b30c-622ac7a45e51 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:11.623612 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-49f563c6-c19c-4d82-8fb4-a50610b20843 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:11.632939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c9eae44a-067c-464c-b30c-622ac7a45e51 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:11.637932 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-49f563c6-c19c-4d82-8fb4-a50610b20843 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1364 microversion: 2.1 time: 0.292629 Aug 03 12:17:11.639126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 355/742] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:11 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1364 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:17:11.642879 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c9eae44a-067c-464c-b30c-622ac7a45e51 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:11.645316 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c9eae44a-067c-464c-b30c-622ac7a45e51 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:11.646941 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c9eae44a-067c-464c-b30c-622ac7a45e51 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.272314 Aug 03 12:17:11.648112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 388/743] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:11 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:11.675975 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-bc6de928-0fbe-40a3-8c1b-1c39d30d0a1b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:11.677702 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-bc6de928-0fbe-40a3-8c1b-1c39d30d0a1b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:11.696981 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bc6de928-0fbe-40a3-8c1b-1c39d30d0a1b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:11.697778 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bc6de928-0fbe-40a3-8c1b-1c39d30d0a1b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:11.699194 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bc6de928-0fbe-40a3-8c1b-1c39d30d0a1b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:11.700197 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bc6de928-0fbe-40a3-8c1b-1c39d30d0a1b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:11.982132 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-bc6de928-0fbe-40a3-8c1b-1c39d30d0a1b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:11.990777 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-bc6de928-0fbe-40a3-8c1b-1c39d30d0a1b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1267 microversion: 2.1 time: 0.321950 Aug 03 12:17:11.991239 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 356/744] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:11 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1267 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:17:12.514079 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-2d4e6dad-572d-4db2-ba8f-edb63fbede03 req-4de6b48e-b5d1-429b-8735-22e7079f3bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d938b6ce-6264-40e3-b1c4-9a523771d549", "tag": "f9c1d2b4-2864-4567-af44-1e67a587e118"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:12.548361 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-2d4e6dad-572d-4db2-ba8f-edb63fbede03 req-4de6b48e-b5d1-429b-8735-22e7079f3bd3 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:12.549403 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-2d4e6dad-572d-4db2-ba8f-edb63fbede03 req-4de6b48e-b5d1-429b-8735-22e7079f3bd3 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:12.565631 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-2d4e6dad-572d-4db2-ba8f-edb63fbede03 req-4de6b48e-b5d1-429b-8735-22e7079f3bd3 service nova] Creating event network-changed:f9c1d2b4-2864-4567-af44-1e67a587e118 for instance d938b6ce-6264-40e3-b1c4-9a523771d549 on hv-cinder-83602 Aug 03 12:17:12.572892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-2d4e6dad-572d-4db2-ba8f-edb63fbede03 req-4de6b48e-b5d1-429b-8735-22e7079f3bd3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061967 Aug 03 12:17:12.573871 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 357/745] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:17:12.577939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-abea468c-6563-413f-975a-fbce46b1e53c req-e6f513f9-aa00-4258-b04b-695d1627bcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df1f8fb-2c96-4ef7-98ce-8df409fa3054", "name": "network-vif-plugged", "status": "completed", "tag": "8da85e18-cee2-4903-a631-2f87bee7cafb"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:12.596119 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-abea468c-6563-413f-975a-fbce46b1e53c req-e6f513f9-aa00-4258-b04b-695d1627bcf6 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:12.597182 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-abea468c-6563-413f-975a-fbce46b1e53c req-e6f513f9-aa00-4258-b04b-695d1627bcf6 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:12.632436 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-abea468c-6563-413f-975a-fbce46b1e53c req-e6f513f9-aa00-4258-b04b-695d1627bcf6 service nova] Creating event network-vif-plugged:8da85e18-cee2-4903-a631-2f87bee7cafb for instance 4df1f8fb-2c96-4ef7-98ce-8df409fa3054 on hv-cinder-83602 Aug 03 12:17:12.638510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-abea468c-6563-413f-975a-fbce46b1e53c req-e6f513f9-aa00-4258-b04b-695d1627bcf6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310680 Aug 03 12:17:12.643258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 389/746] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:17:12.694066 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c9a2e747-f104-4a97-ab3a-fd3180034e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:12.695153 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-c9a2e747-f104-4a97-ab3a-fd3180034e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:12.698862 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d0f619aa-9d67-44e6-b9da-5e8fc17fe25c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:12.699857 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d0f619aa-9d67-44e6-b9da-5e8fc17fe25c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:12.702361 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c9a2e747-f104-4a97-ab3a-fd3180034e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:12.703133 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c9a2e747-f104-4a97-ab3a-fd3180034e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:12.704424 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c9a2e747-f104-4a97-ab3a-fd3180034e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:12.704870 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c9a2e747-f104-4a97-ab3a-fd3180034e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:12.707196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0f619aa-9d67-44e6-b9da-5e8fc17fe25c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:12.708408 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0f619aa-9d67-44e6-b9da-5e8fc17fe25c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:12.709410 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0f619aa-9d67-44e6-b9da-5e8fc17fe25c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:12.710003 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0f619aa-9d67-44e6-b9da-5e8fc17fe25c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:12.873917 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d0f619aa-9d67-44e6-b9da-5e8fc17fe25c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:12.882574 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d0f619aa-9d67-44e6-b9da-5e8fc17fe25c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1364 microversion: 2.1 time: 0.188669 Aug 03 12:17:12.882889 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 390/747] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:12 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:12.953535 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-c9a2e747-f104-4a97-ab3a-fd3180034e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:12.962023 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-c9a2e747-f104-4a97-ab3a-fd3180034e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:12.964066 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-c9a2e747-f104-4a97-ab3a-fd3180034e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:12.965564 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c9a2e747-f104-4a97-ab3a-fd3180034e7d tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.276182 Aug 03 12:17:12.966644 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 358/748] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:12 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:13.017392 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fd75b6c5-34aa-4b48-8c85-12f4c99718e1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:13.018260 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fd75b6c5-34aa-4b48-8c85-12f4c99718e1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:13.028637 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fd75b6c5-34aa-4b48-8c85-12f4c99718e1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:13.029366 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fd75b6c5-34aa-4b48-8c85-12f4c99718e1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:13.031423 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fd75b6c5-34aa-4b48-8c85-12f4c99718e1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:13.031423 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fd75b6c5-34aa-4b48-8c85-12f4c99718e1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:13.183108 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-fd75b6c5-34aa-4b48-8c85-12f4c99718e1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:13.191236 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-fd75b6c5-34aa-4b48-8c85-12f4c99718e1 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1267 microversion: 2.1 time: 0.177627 Aug 03 12:17:13.191879 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 391/749] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:13 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:13.907419 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-46b50126-d144-49cd-8f70-e5e6f3d34922 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:13.908413 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-46b50126-d144-49cd-8f70-e5e6f3d34922 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:13.916295 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46b50126-d144-49cd-8f70-e5e6f3d34922 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:13.916749 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46b50126-d144-49cd-8f70-e5e6f3d34922 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:13.917529 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46b50126-d144-49cd-8f70-e5e6f3d34922 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:13.917973 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46b50126-d144-49cd-8f70-e5e6f3d34922 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:14.003375 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-35c3b6b1-c1e1-4b6b-8dc4-d253b052f128 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:14.005223 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-35c3b6b1-c1e1-4b6b-8dc4-d253b052f128 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:14.018001 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-35c3b6b1-c1e1-4b6b-8dc4-d253b052f128 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:14.018926 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-35c3b6b1-c1e1-4b6b-8dc4-d253b052f128 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:14.021478 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-35c3b6b1-c1e1-4b6b-8dc4-d253b052f128 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:14.022422 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-35c3b6b1-c1e1-4b6b-8dc4-d253b052f128 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:14.131869 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-46b50126-d144-49cd-8f70-e5e6f3d34922 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:14.140563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-46b50126-d144-49cd-8f70-e5e6f3d34922 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1364 microversion: 2.1 time: 0.239989 Aug 03 12:17:14.141239 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 359/750] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:13 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:14.205873 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-35c3b6b1-c1e1-4b6b-8dc4-d253b052f128 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:14.215142 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d772c49f-38c1-4dfd-bfdb-930b2aa3bd27 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:14.215334 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-35c3b6b1-c1e1-4b6b-8dc4-d253b052f128 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:14.215835 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d772c49f-38c1-4dfd-bfdb-930b2aa3bd27 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:14.216834 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-35c3b6b1-c1e1-4b6b-8dc4-d253b052f128 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:14.218023 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-35c3b6b1-c1e1-4b6b-8dc4-d253b052f128 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.224460 Aug 03 12:17:14.218817 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 392/751] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:13 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:14.223765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d772c49f-38c1-4dfd-bfdb-930b2aa3bd27 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:14.224087 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d772c49f-38c1-4dfd-bfdb-930b2aa3bd27 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:14.224880 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d772c49f-38c1-4dfd-bfdb-930b2aa3bd27 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:14.225322 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d772c49f-38c1-4dfd-bfdb-930b2aa3bd27 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:14.399342 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d772c49f-38c1-4dfd-bfdb-930b2aa3bd27 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:14.408409 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d772c49f-38c1-4dfd-bfdb-930b2aa3bd27 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1267 microversion: 2.1 time: 0.199096 Aug 03 12:17:14.409013 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 360/752] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:14 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:17:15.162428 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5bb998ea-5ae7-429f-88d3-fff6abdc071c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:15.163181 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5bb998ea-5ae7-429f-88d3-fff6abdc071c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:15.170341 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5bb998ea-5ae7-429f-88d3-fff6abdc071c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:15.170840 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5bb998ea-5ae7-429f-88d3-fff6abdc071c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:15.171646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5bb998ea-5ae7-429f-88d3-fff6abdc071c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:15.172089 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5bb998ea-5ae7-429f-88d3-fff6abdc071c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:15.243982 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e32249f0-883a-4a94-ae3b-adc7bfe0257b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:15.245004 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e32249f0-883a-4a94-ae3b-adc7bfe0257b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:15.253112 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e32249f0-883a-4a94-ae3b-adc7bfe0257b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:15.253632 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e32249f0-883a-4a94-ae3b-adc7bfe0257b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:15.255171 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e32249f0-883a-4a94-ae3b-adc7bfe0257b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:15.255730 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e32249f0-883a-4a94-ae3b-adc7bfe0257b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:15.352481 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5bb998ea-5ae7-429f-88d3-fff6abdc071c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:15.364427 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5bb998ea-5ae7-429f-88d3-fff6abdc071c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1364 microversion: 2.1 time: 0.206398 Aug 03 12:17:15.365738 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 393/753] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:15 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:15.431331 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-969fcb9e-ae00-4297-83ff-124d2a8f8af8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:15.432071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-969fcb9e-ae00-4297-83ff-124d2a8f8af8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:15.438337 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-969fcb9e-ae00-4297-83ff-124d2a8f8af8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:15.438918 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-969fcb9e-ae00-4297-83ff-124d2a8f8af8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:15.439625 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-969fcb9e-ae00-4297-83ff-124d2a8f8af8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:15.440067 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-969fcb9e-ae00-4297-83ff-124d2a8f8af8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:15.515915 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e32249f0-883a-4a94-ae3b-adc7bfe0257b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:15.525962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e32249f0-883a-4a94-ae3b-adc7bfe0257b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:15.527551 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e32249f0-883a-4a94-ae3b-adc7bfe0257b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:15.529169 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e32249f0-883a-4a94-ae3b-adc7bfe0257b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.291152 Aug 03 12:17:15.529752 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 361/754] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:15 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:15.595801 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-969fcb9e-ae00-4297-83ff-124d2a8f8af8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:15.603890 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-969fcb9e-ae00-4297-83ff-124d2a8f8af8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1455 microversion: 2.1 time: 0.177676 Aug 03 12:17:15.604477 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 394/755] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:15 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1455 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:17:15.626594 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3880a6ae-d792-44ee-8bef-40f8b3f1b591 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:15.627399 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-3880a6ae-d792-44ee-8bef-40f8b3f1b591 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:15.635075 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3880a6ae-d792-44ee-8bef-40f8b3f1b591 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:15.635528 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3880a6ae-d792-44ee-8bef-40f8b3f1b591 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:15.636329 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3880a6ae-d792-44ee-8bef-40f8b3f1b591 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:15.636887 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3880a6ae-d792-44ee-8bef-40f8b3f1b591 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:15.789599 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-3880a6ae-d792-44ee-8bef-40f8b3f1b591 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:15.797557 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-3880a6ae-d792-44ee-8bef-40f8b3f1b591 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1455 microversion: 2.1 time: 0.174798 Aug 03 12:17:15.798138 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 362/756] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:15 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1455 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:16.403739 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-202f21a1-4016-4211-86d8-7ce11275d616 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:16.405076 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-202f21a1-4016-4211-86d8-7ce11275d616 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:16.412295 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-202f21a1-4016-4211-86d8-7ce11275d616 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:16.412834 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-202f21a1-4016-4211-86d8-7ce11275d616 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:16.413842 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-202f21a1-4016-4211-86d8-7ce11275d616 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:16.414284 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-202f21a1-4016-4211-86d8-7ce11275d616 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:16.558716 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-332158c4-d07a-43b6-a989-56c81c5d0404 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:16.560933 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-332158c4-d07a-43b6-a989-56c81c5d0404 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:16.574918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-332158c4-d07a-43b6-a989-56c81c5d0404 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:16.575847 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-332158c4-d07a-43b6-a989-56c81c5d0404 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:16.577401 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-332158c4-d07a-43b6-a989-56c81c5d0404 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:16.578473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-332158c4-d07a-43b6-a989-56c81c5d0404 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:16.667425 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-202f21a1-4016-4211-86d8-7ce11275d616 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:16.678481 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-202f21a1-4016-4211-86d8-7ce11275d616 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1364 microversion: 2.1 time: 0.278291 Aug 03 12:17:16.679285 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 395/757] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:16 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1364 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:16.760961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-332158c4-d07a-43b6-a989-56c81c5d0404 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:16.769892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-332158c4-d07a-43b6-a989-56c81c5d0404 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:16.771539 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-332158c4-d07a-43b6-a989-56c81c5d0404 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:16.772736 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-332158c4-d07a-43b6-a989-56c81c5d0404 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1744 microversion: 2.20 time: 0.222680 Aug 03 12:17:16.773317 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 363/758] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:16 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:17.716116 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bdcb99c0-1830-4eb2-bd7d-c5f0536737a5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:17.716993 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bdcb99c0-1830-4eb2-bd7d-c5f0536737a5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:17.724838 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bdcb99c0-1830-4eb2-bd7d-c5f0536737a5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:17.725290 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bdcb99c0-1830-4eb2-bd7d-c5f0536737a5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:17.726084 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bdcb99c0-1830-4eb2-bd7d-c5f0536737a5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:17.726560 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bdcb99c0-1830-4eb2-bd7d-c5f0536737a5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:17.814786 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6f4622bc-52c0-41f2-8da3-f9c2914c5c20 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:17.815519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-6f4622bc-52c0-41f2-8da3-f9c2914c5c20 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:17.828424 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6f4622bc-52c0-41f2-8da3-f9c2914c5c20 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:17.833005 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6f4622bc-52c0-41f2-8da3-f9c2914c5c20 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:17.834214 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6f4622bc-52c0-41f2-8da3-f9c2914c5c20 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:17.834864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6f4622bc-52c0-41f2-8da3-f9c2914c5c20 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:17.940466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bdcb99c0-1830-4eb2-bd7d-c5f0536737a5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:17.956304 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bdcb99c0-1830-4eb2-bd7d-c5f0536737a5 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1364 microversion: 2.1 time: 0.245528 Aug 03 12:17:17.956918 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 396/759] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:17 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:18.009866 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-5d138cae-2c90-4c35-b408-37bd2e23a978 req-a84bf3d1-c584-4391-ab86-e4e126893f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df1f8fb-2c96-4ef7-98ce-8df409fa3054", "tag": "8da85e18-cee2-4903-a631-2f87bee7cafb"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:18.030236 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-5d138cae-2c90-4c35-b408-37bd2e23a978 req-a84bf3d1-c584-4391-ab86-e4e126893f48 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:18.031090 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-5d138cae-2c90-4c35-b408-37bd2e23a978 req-a84bf3d1-c584-4391-ab86-e4e126893f48 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:18.053403 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-5d138cae-2c90-4c35-b408-37bd2e23a978 req-a84bf3d1-c584-4391-ab86-e4e126893f48 service nova] Creating event network-changed:8da85e18-cee2-4903-a631-2f87bee7cafb for instance 4df1f8fb-2c96-4ef7-98ce-8df409fa3054 on hv-cinder-83602 Aug 03 12:17:18.062274 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-5d138cae-2c90-4c35-b408-37bd2e23a978 req-a84bf3d1-c584-4391-ab86-e4e126893f48 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061690 Aug 03 12:17:18.063775 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 397/760] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:17:18.120171 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-6f4622bc-52c0-41f2-8da3-f9c2914c5c20 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:18.133585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-6f4622bc-52c0-41f2-8da3-f9c2914c5c20 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:18.135465 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-6f4622bc-52c0-41f2-8da3-f9c2914c5c20 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:18.137074 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6f4622bc-52c0-41f2-8da3-f9c2914c5c20 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1744 microversion: 2.20 time: 0.326796 Aug 03 12:17:18.138779 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 364/761] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:17 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1744 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:17:18.541326 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-75244e82-35ac-48f4-bb86-db52e7b5374b req-de3e76ac-c150-4613-adaa-0f314eabc6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5335f69-42aa-4fcf-8ee9-223f8e1485ec", "name": "network-vif-plugged", "status": "completed", "tag": "02cf3d48-0345-435e-ba69-48f06b2d3b86"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:18.557044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-75244e82-35ac-48f4-bb86-db52e7b5374b req-de3e76ac-c150-4613-adaa-0f314eabc6e2 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:18.557485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-75244e82-35ac-48f4-bb86-db52e7b5374b req-de3e76ac-c150-4613-adaa-0f314eabc6e2 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:18.575063 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-75244e82-35ac-48f4-bb86-db52e7b5374b req-de3e76ac-c150-4613-adaa-0f314eabc6e2 service nova] Creating event network-vif-plugged:02cf3d48-0345-435e-ba69-48f06b2d3b86 for instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec on hv-cinder-83602 Aug 03 12:17:18.581629 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-75244e82-35ac-48f4-bb86-db52e7b5374b req-de3e76ac-c150-4613-adaa-0f314eabc6e2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047697 Aug 03 12:17:18.583267 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 398/762] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:17:18.979643 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-434a3475-ae8e-441e-ad52-449a01fce82a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:18.980319 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-434a3475-ae8e-441e-ad52-449a01fce82a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:18.984855 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:18.990648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-434a3475-ae8e-441e-ad52-449a01fce82a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:18.991102 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-434a3475-ae8e-441e-ad52-449a01fce82a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:18.991893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-434a3475-ae8e-441e-ad52-449a01fce82a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:18.992331 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-434a3475-ae8e-441e-ad52-449a01fce82a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:19.126725 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=18 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:19.171283 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b57c3ff2-74d5-425d-a4ce-222ae0c2d961 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:19.175719 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b57c3ff2-74d5-425d-a4ce-222ae0c2d961 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:19.192745 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b57c3ff2-74d5-425d-a4ce-222ae0c2d961 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:19.193069 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b57c3ff2-74d5-425d-a4ce-222ae0c2d961 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:19.195084 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b57c3ff2-74d5-425d-a4ce-222ae0c2d961 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:19.196541 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b57c3ff2-74d5-425d-a4ce-222ae0c2d961 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:19.391508 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b57c3ff2-74d5-425d-a4ce-222ae0c2d961 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:19.402520 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b57c3ff2-74d5-425d-a4ce-222ae0c2d961 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:19.405388 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b57c3ff2-74d5-425d-a4ce-222ae0c2d961 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:19.413834 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b57c3ff2-74d5-425d-a4ce-222ae0c2d961 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1739 microversion: 2.20 time: 0.253265 Aug 03 12:17:19.419813 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 399/763] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:19 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1739 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:17:19.521444 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-434a3475-ae8e-441e-ad52-449a01fce82a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:19.529916 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-434a3475-ae8e-441e-ad52-449a01fce82a tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1364 microversion: 2.1 time: 0.554133 Aug 03 12:17:19.530563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 365/764] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:18 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1364 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:20.443684 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-df653840-186a-42d7-8610-83095d58a8dc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:20.446096 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-df653840-186a-42d7-8610-83095d58a8dc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:20.453863 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df653840-186a-42d7-8610-83095d58a8dc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:20.454736 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df653840-186a-42d7-8610-83095d58a8dc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:20.455758 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df653840-186a-42d7-8610-83095d58a8dc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:20.456413 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-df653840-186a-42d7-8610-83095d58a8dc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:20.553853 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d2123804-edd8-4c6c-a930-7bbe648cdc80 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:20.555331 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d2123804-edd8-4c6c-a930-7bbe648cdc80 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:20.567016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d2123804-edd8-4c6c-a930-7bbe648cdc80 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:20.567469 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d2123804-edd8-4c6c-a930-7bbe648cdc80 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:20.568513 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d2123804-edd8-4c6c-a930-7bbe648cdc80 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:20.569343 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d2123804-edd8-4c6c-a930-7bbe648cdc80 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:20.642756 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-df653840-186a-42d7-8610-83095d58a8dc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:20.659897 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-df653840-186a-42d7-8610-83095d58a8dc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:20.662782 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-df653840-186a-42d7-8610-83095d58a8dc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:20.666512 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-df653840-186a-42d7-8610-83095d58a8dc tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1739 microversion: 2.20 time: 0.229045 Aug 03 12:17:20.667872 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 400/765] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:20 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:20.674271 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-7df24736-3fb0-41b8-a51f-526df89506ba req-53e352de-08f4-401f-861b-f1c977b54cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d938b6ce-6264-40e3-b1c4-9a523771d549", "name": "network-vif-plugged", "status": "completed", "tag": "f9c1d2b4-2864-4567-af44-1e67a587e118"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:20.691756 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-7df24736-3fb0-41b8-a51f-526df89506ba req-53e352de-08f4-401f-861b-f1c977b54cc5 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:20.692785 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-7df24736-3fb0-41b8-a51f-526df89506ba req-53e352de-08f4-401f-861b-f1c977b54cc5 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:20.713224 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-7df24736-3fb0-41b8-a51f-526df89506ba req-53e352de-08f4-401f-861b-f1c977b54cc5 service nova] Creating event network-vif-plugged:f9c1d2b4-2864-4567-af44-1e67a587e118 for instance d938b6ce-6264-40e3-b1c4-9a523771d549 on hv-cinder-83602 Aug 03 12:17:20.719309 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-7df24736-3fb0-41b8-a51f-526df89506ba req-53e352de-08f4-401f-861b-f1c977b54cc5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049443 Aug 03 12:17:20.720177 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 401/766] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:17:20.807314 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d2123804-edd8-4c6c-a930-7bbe648cdc80 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:20.817398 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d2123804-edd8-4c6c-a930-7bbe648cdc80 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1364 microversion: 2.1 time: 0.267500 Aug 03 12:17:20.833860 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 366/767] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:20 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1364 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:21.695761 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e12565a9-4534-4802-89c2-dbff15bfc81c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:21.697586 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e12565a9-4534-4802-89c2-dbff15bfc81c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:21.706791 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e12565a9-4534-4802-89c2-dbff15bfc81c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:21.708662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e12565a9-4534-4802-89c2-dbff15bfc81c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:21.710495 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e12565a9-4534-4802-89c2-dbff15bfc81c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:21.711425 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e12565a9-4534-4802-89c2-dbff15bfc81c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:21.840506 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5850828a-f389-4ed3-b146-d634700bea36 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:21.841791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5850828a-f389-4ed3-b146-d634700bea36 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:21.850968 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5850828a-f389-4ed3-b146-d634700bea36 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:21.851704 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5850828a-f389-4ed3-b146-d634700bea36 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:21.852866 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5850828a-f389-4ed3-b146-d634700bea36 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:21.853456 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5850828a-f389-4ed3-b146-d634700bea36 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:21.892277 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e12565a9-4534-4802-89c2-dbff15bfc81c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:21.908617 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e12565a9-4534-4802-89c2-dbff15bfc81c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:21.912055 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e12565a9-4534-4802-89c2-dbff15bfc81c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:21.914871 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e12565a9-4534-4802-89c2-dbff15bfc81c tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1739 microversion: 2.20 time: 0.224938 Aug 03 12:17:21.917308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 402/768] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:21 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:22.018086 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5850828a-f389-4ed3-b146-d634700bea36 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:22.027669 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5850828a-f389-4ed3-b146-d634700bea36 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1364 microversion: 2.1 time: 0.191328 Aug 03 12:17:22.028519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 367/769] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:21 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:17:22.944187 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9854266c-d5c7-4334-bf13-d75335f61ffd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:22.945852 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9854266c-d5c7-4334-bf13-d75335f61ffd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:22.953586 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9854266c-d5c7-4334-bf13-d75335f61ffd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:22.954273 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9854266c-d5c7-4334-bf13-d75335f61ffd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:22.955247 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9854266c-d5c7-4334-bf13-d75335f61ffd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:22.956284 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9854266c-d5c7-4334-bf13-d75335f61ffd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:23.052408 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-916c8f1d-421a-453a-8ea1-655e8344bf10 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:23.053254 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-916c8f1d-421a-453a-8ea1-655e8344bf10 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:23.065432 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-916c8f1d-421a-453a-8ea1-655e8344bf10 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:23.068131 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-916c8f1d-421a-453a-8ea1-655e8344bf10 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:23.072308 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-916c8f1d-421a-453a-8ea1-655e8344bf10 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:23.075575 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-916c8f1d-421a-453a-8ea1-655e8344bf10 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:23.233014 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9854266c-d5c7-4334-bf13-d75335f61ffd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:23.250911 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9854266c-d5c7-4334-bf13-d75335f61ffd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:23.258139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9854266c-d5c7-4334-bf13-d75335f61ffd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:23.260252 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9854266c-d5c7-4334-bf13-d75335f61ffd tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1739 microversion: 2.20 time: 0.325322 Aug 03 12:17:23.262562 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 403/770] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:22 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:17:23.274055 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-916c8f1d-421a-453a-8ea1-655e8344bf10 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:23.283175 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-916c8f1d-421a-453a-8ea1-655e8344bf10 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1550 microversion: 2.1 time: 0.237067 Aug 03 12:17:23.283878 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 368/771] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:23 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1550 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:23.353497 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c7c9338d-43ab-4fc0-afec-8fb32f500452 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:23.362379 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c7c9338d-43ab-4fc0-afec-8fb32f500452 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:23.377949 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7c9338d-43ab-4fc0-afec-8fb32f500452 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:23.378553 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7c9338d-43ab-4fc0-afec-8fb32f500452 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:23.380021 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7c9338d-43ab-4fc0-afec-8fb32f500452 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:23.380458 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7c9338d-43ab-4fc0-afec-8fb32f500452 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:23.517281 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c7c9338d-43ab-4fc0-afec-8fb32f500452 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.193365 Aug 03 12:17:23.519470 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 404/772] 10.222.0.17 () {58 vars in 1275 bytes} [Wed Aug 3 12:17:23 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:17:24.287000 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f5aef1e8-2b49-4249-9b7e-0bf963e230a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:24.288448 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f5aef1e8-2b49-4249-9b7e-0bf963e230a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:24.296844 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f5aef1e8-2b49-4249-9b7e-0bf963e230a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:24.297602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f5aef1e8-2b49-4249-9b7e-0bf963e230a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:24.298812 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f5aef1e8-2b49-4249-9b7e-0bf963e230a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:24.299427 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f5aef1e8-2b49-4249-9b7e-0bf963e230a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:24.494992 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f5aef1e8-2b49-4249-9b7e-0bf963e230a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:24.506203 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f5aef1e8-2b49-4249-9b7e-0bf963e230a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:24.508342 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f5aef1e8-2b49-4249-9b7e-0bf963e230a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:24.510254 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f5aef1e8-2b49-4249-9b7e-0bf963e230a3 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1739 microversion: 2.20 time: 0.228309 Aug 03 12:17:24.511403 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 369/773] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:24 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:17:25.087529 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-8ff8f72a-f9ac-49c0-87eb-ed3f092ff8b5 req-a2556784-9d4f-4dbd-a686-3f811603e8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d938b6ce-6264-40e3-b1c4-9a523771d549", "tag": "f9c1d2b4-2864-4567-af44-1e67a587e118"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:25.110655 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-8ff8f72a-f9ac-49c0-87eb-ed3f092ff8b5 req-a2556784-9d4f-4dbd-a686-3f811603e8e6 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:25.111622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-8ff8f72a-f9ac-49c0-87eb-ed3f092ff8b5 req-a2556784-9d4f-4dbd-a686-3f811603e8e6 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:25.127514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-8ff8f72a-f9ac-49c0-87eb-ed3f092ff8b5 req-a2556784-9d4f-4dbd-a686-3f811603e8e6 service nova] Creating event network-changed:f9c1d2b4-2864-4567-af44-1e67a587e118 for instance d938b6ce-6264-40e3-b1c4-9a523771d549 on hv-cinder-83602 Aug 03 12:17:25.134483 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-8ff8f72a-f9ac-49c0-87eb-ed3f092ff8b5 req-a2556784-9d4f-4dbd-a686-3f811603e8e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049829 Aug 03 12:17:25.139411 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 405/774] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:17:25.567703 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cb9a7b35-1f7f-4779-9ae7-9c707dc17f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:25.568552 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-cb9a7b35-1f7f-4779-9ae7-9c707dc17f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:25.606266 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cb9a7b35-1f7f-4779-9ae7-9c707dc17f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:25.606769 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cb9a7b35-1f7f-4779-9ae7-9c707dc17f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:25.607614 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cb9a7b35-1f7f-4779-9ae7-9c707dc17f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:25.608057 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cb9a7b35-1f7f-4779-9ae7-9c707dc17f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:25.826130 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cb9a7b35-1f7f-4779-9ae7-9c707dc17f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:25.842592 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cb9a7b35-1f7f-4779-9ae7-9c707dc17f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:25.845819 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cb9a7b35-1f7f-4779-9ae7-9c707dc17f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:25.851067 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-cb9a7b35-1f7f-4779-9ae7-9c707dc17f61 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1739 microversion: 2.20 time: 0.305899 Aug 03 12:17:25.853954 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 370/775] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:25 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1739 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:26.883958 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f8e7e3b0-4075-4133-83a4-cddfd115bdb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:26.886147 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f8e7e3b0-4075-4133-83a4-cddfd115bdb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:26.896723 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8e7e3b0-4075-4133-83a4-cddfd115bdb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:26.897448 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8e7e3b0-4075-4133-83a4-cddfd115bdb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:26.898755 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8e7e3b0-4075-4133-83a4-cddfd115bdb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:26.899392 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8e7e3b0-4075-4133-83a4-cddfd115bdb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:26.924661 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=100 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:27.099918 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f8e7e3b0-4075-4133-83a4-cddfd115bdb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:27.110495 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f8e7e3b0-4075-4133-83a4-cddfd115bdb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:27.112361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f8e7e3b0-4075-4133-83a4-cddfd115bdb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:27.114185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f8e7e3b0-4075-4133-83a4-cddfd115bdb2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1739 microversion: 2.20 time: 0.238051 Aug 03 12:17:27.115343 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 406/776] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:26 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:28.140662 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-56100b77-ce42-4502-ac10-f7835c51d1e0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:28.142742 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-56100b77-ce42-4502-ac10-f7835c51d1e0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:28.155734 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-56100b77-ce42-4502-ac10-f7835c51d1e0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:28.156568 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-56100b77-ce42-4502-ac10-f7835c51d1e0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:28.157599 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-56100b77-ce42-4502-ac10-f7835c51d1e0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:28.158041 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-56100b77-ce42-4502-ac10-f7835c51d1e0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:28.383787 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-56100b77-ce42-4502-ac10-f7835c51d1e0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:28.387611 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=100 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:28.396644 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-56100b77-ce42-4502-ac10-f7835c51d1e0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:28.398284 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-56100b77-ce42-4502-ac10-f7835c51d1e0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:28.399801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-56100b77-ce42-4502-ac10-f7835c51d1e0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1739 microversion: 2.20 time: 0.264971 Aug 03 12:17:28.406500 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 371/777] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:28 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:29.437575 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5b8b76d5-d6ea-40b9-a750-59bce981cc48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:29.439714 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5b8b76d5-d6ea-40b9-a750-59bce981cc48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:29.451318 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b8b76d5-d6ea-40b9-a750-59bce981cc48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:29.452155 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b8b76d5-d6ea-40b9-a750-59bce981cc48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:29.453664 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b8b76d5-d6ea-40b9-a750-59bce981cc48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:29.454567 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b8b76d5-d6ea-40b9-a750-59bce981cc48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:29.676703 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5b8b76d5-d6ea-40b9-a750-59bce981cc48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:29.692755 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5b8b76d5-d6ea-40b9-a750-59bce981cc48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:29.695920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5b8b76d5-d6ea-40b9-a750-59bce981cc48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:29.698243 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5b8b76d5-d6ea-40b9-a750-59bce981cc48 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1739 microversion: 2.20 time: 0.267318 Aug 03 12:17:29.699728 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 407/778] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:29 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:30.724944 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-699c4ed9-2274-433d-b35b-d3321d01b8a0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:30.725773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-699c4ed9-2274-433d-b35b-d3321d01b8a0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:30.733290 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-699c4ed9-2274-433d-b35b-d3321d01b8a0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:30.733732 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-699c4ed9-2274-433d-b35b-d3321d01b8a0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:30.734539 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-699c4ed9-2274-433d-b35b-d3321d01b8a0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:30.734976 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-699c4ed9-2274-433d-b35b-d3321d01b8a0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:30.887543 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-699c4ed9-2274-433d-b35b-d3321d01b8a0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:30.897022 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-699c4ed9-2274-433d-b35b-d3321d01b8a0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:30.898672 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-699c4ed9-2274-433d-b35b-d3321d01b8a0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:30.899930 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-699c4ed9-2274-433d-b35b-d3321d01b8a0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1739 microversion: 2.20 time: 0.179037 Aug 03 12:17:30.900504 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 372/779] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:30 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:31.924147 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d29bde31-23b6-4268-9b0d-489f936528c7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:31.924769 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d29bde31-23b6-4268-9b0d-489f936528c7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:31.932711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d29bde31-23b6-4268-9b0d-489f936528c7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:31.933164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d29bde31-23b6-4268-9b0d-489f936528c7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:31.933974 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d29bde31-23b6-4268-9b0d-489f936528c7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:31.934419 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d29bde31-23b6-4268-9b0d-489f936528c7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:32.371090 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d29bde31-23b6-4268-9b0d-489f936528c7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:32.379878 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d29bde31-23b6-4268-9b0d-489f936528c7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:32.381421 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d29bde31-23b6-4268-9b0d-489f936528c7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:32.382671 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d29bde31-23b6-4268-9b0d-489f936528c7 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1721 microversion: 2.20 time: 0.462705 Aug 03 12:17:32.383243 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 408/780] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:31 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1721 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:33.410952 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f5c1e314-5e4e-45d3-be17-e31c804d4816 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:33.411608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f5c1e314-5e4e-45d3-be17-e31c804d4816 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:33.418515 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f5c1e314-5e4e-45d3-be17-e31c804d4816 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:33.418993 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f5c1e314-5e4e-45d3-be17-e31c804d4816 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:33.419813 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f5c1e314-5e4e-45d3-be17-e31c804d4816 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:33.420241 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f5c1e314-5e4e-45d3-be17-e31c804d4816 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:33.560468 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f5c1e314-5e4e-45d3-be17-e31c804d4816 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:33.568688 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f5c1e314-5e4e-45d3-be17-e31c804d4816 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:33.570090 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f5c1e314-5e4e-45d3-be17-e31c804d4816 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:33.571293 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f5c1e314-5e4e-45d3-be17-e31c804d4816 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1721 microversion: 2.20 time: 0.164968 Aug 03 12:17:33.572021 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 373/781] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:33 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:34.273204 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-eb4e3da9-1ba9-4a21-a7e1-761702603745 req-6d221e5e-ff02-4aaf-969d-2ad7555dbab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5335f69-42aa-4fcf-8ee9-223f8e1485ec", "name": "network-vif-unplugged", "status": "completed", "tag": "02cf3d48-0345-435e-ba69-48f06b2d3b86"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:34.283316 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-eb4e3da9-1ba9-4a21-a7e1-761702603745 req-6d221e5e-ff02-4aaf-969d-2ad7555dbab6 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:34.283769 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-eb4e3da9-1ba9-4a21-a7e1-761702603745 req-6d221e5e-ff02-4aaf-969d-2ad7555dbab6 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:34.298384 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.compute.server_external_events [req-eb4e3da9-1ba9-4a21-a7e1-761702603745 req-6d221e5e-ff02-4aaf-969d-2ad7555dbab6 service nova] Unable to find a host for instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec. Dropping event network-vif-unplugged {{(pid=117910) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 12:17:34.299445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-eb4e3da9-1ba9-4a21-a7e1-761702603745 req-6d221e5e-ff02-4aaf-969d-2ad7555dbab6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031339 Aug 03 12:17:34.300081 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 409/782] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 03 12:17:34.595540 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-323c44bf-7815-475c-afa7-5c7466bd2f58 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:34.596102 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-323c44bf-7815-475c-afa7-5c7466bd2f58 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:34.603518 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-323c44bf-7815-475c-afa7-5c7466bd2f58 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:34.603969 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-323c44bf-7815-475c-afa7-5c7466bd2f58 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:34.604752 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-323c44bf-7815-475c-afa7-5c7466bd2f58 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:34.605193 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-323c44bf-7815-475c-afa7-5c7466bd2f58 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:34.744095 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-323c44bf-7815-475c-afa7-5c7466bd2f58 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:34.752761 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-323c44bf-7815-475c-afa7-5c7466bd2f58 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:34.754798 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-323c44bf-7815-475c-afa7-5c7466bd2f58 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:34.755981 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-323c44bf-7815-475c-afa7-5c7466bd2f58 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1664 microversion: 2.20 time: 0.164528 Aug 03 12:17:34.756548 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 374/783] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:34 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:17:34.781711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5fa01757-d835-4c50-9d66-cc0df541afe5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edfcecbf-82aa-4c58-810e-32a149691215"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:34.784372 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5fa01757-d835-4c50-9d66-cc0df541afe5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:34.791146 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5fa01757-d835-4c50-9d66-cc0df541afe5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:34.791604 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5fa01757-d835-4c50-9d66-cc0df541afe5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:34.792425 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5fa01757-d835-4c50-9d66-cc0df541afe5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:34.792869 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5fa01757-d835-4c50-9d66-cc0df541afe5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:35.100381 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5fa01757-d835-4c50-9d66-cc0df541afe5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "POST /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.322982 Aug 03 12:17:35.100914 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 410/784] 10.222.0.17 () {62 vars in 1364 bytes} [Wed Aug 3 12:17:34 2022] POST /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/os-volume_attachments => generated 188 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 12:17:35.238770 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4dbc8b31-901c-471e-95ec-60a82e28446f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:35.239361 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-4dbc8b31-901c-471e-95ec-60a82e28446f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:35.247734 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4dbc8b31-901c-471e-95ec-60a82e28446f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:35.248185 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4dbc8b31-901c-471e-95ec-60a82e28446f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:35.249175 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4dbc8b31-901c-471e-95ec-60a82e28446f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:35.249719 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4dbc8b31-901c-471e-95ec-60a82e28446f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:35.279182 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-33c8b424-a74e-4386-989c-3e900ab95f8d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:35.279739 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-33c8b424-a74e-4386-989c-3e900ab95f8d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:35.286334 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-33c8b424-a74e-4386-989c-3e900ab95f8d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:35.286889 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-33c8b424-a74e-4386-989c-3e900ab95f8d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:35.287670 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-33c8b424-a74e-4386-989c-3e900ab95f8d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:35.288105 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-33c8b424-a74e-4386-989c-3e900ab95f8d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:35.315074 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-33c8b424-a74e-4386-989c-3e900ab95f8d tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09/ips" status: 200 len: 150 microversion: 2.1 time: 0.039850 Aug 03 12:17:35.315988 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 411/785] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 3 12:17:35 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:17:35.580414 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-4dbc8b31-901c-471e-95ec-60a82e28446f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/os-volume_attachments/edfcecbf-82aa-4c58-810e-32a149691215" status: 202 len: 0 microversion: 2.20 time: 0.346481 Aug 03 12:17:35.581188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 375/786] 10.222.0.17 () {60 vars in 1457 bytes} [Wed Aug 3 12:17:35 2022] DELETE /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/os-volume_attachments/edfcecbf-82aa-4c58-810e-32a149691215 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:17:35.658524 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-65de71c6-52d0-4bf0-88e5-88d7dbdba162 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:35.659127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-65de71c6-52d0-4bf0-88e5-88d7dbdba162 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:35.666493 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-65de71c6-52d0-4bf0-88e5-88d7dbdba162 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:35.666956 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-65de71c6-52d0-4bf0-88e5-88d7dbdba162 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:35.667742 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-65de71c6-52d0-4bf0-88e5-88d7dbdba162 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:35.668185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-65de71c6-52d0-4bf0-88e5-88d7dbdba162 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:35.813108 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-65de71c6-52d0-4bf0-88e5-88d7dbdba162 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117910) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 12:17:35.893835 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-65de71c6-52d0-4bf0-88e5-88d7dbdba162 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "POST /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/action" status: 202 len: 0 microversion: 2.20 time: 0.240217 Aug 03 12:17:35.895331 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 412/787] 10.222.0.17 () {62 vars in 1319 bytes} [Wed Aug 3 12:17:35 2022] POST /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:17:35.903793 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7f460520-7caa-4a8b-ad19-dbedc12980a6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:35.904404 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7f460520-7caa-4a8b-ad19-dbedc12980a6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:35.912070 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7f460520-7caa-4a8b-ad19-dbedc12980a6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:35.912512 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7f460520-7caa-4a8b-ad19-dbedc12980a6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:35.913282 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7f460520-7caa-4a8b-ad19-dbedc12980a6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:35.913715 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7f460520-7caa-4a8b-ad19-dbedc12980a6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:36.101276 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7f460520-7caa-4a8b-ad19-dbedc12980a6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:36.109286 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7f460520-7caa-4a8b-ad19-dbedc12980a6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:36.111446 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7f460520-7caa-4a8b-ad19-dbedc12980a6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:36.112605 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7f460520-7caa-4a8b-ad19-dbedc12980a6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1672 microversion: 2.20 time: 0.213175 Aug 03 12:17:36.113161 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 376/788] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:35 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1672 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:36.727521 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-72aad59f-1473-4b52-aec6-5e4dbf4a0ead tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3518e42e-99b1-4fbf-9319-6fd95fe7663e"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:36.729835 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-72aad59f-1473-4b52-aec6-5e4dbf4a0ead tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:36.731712 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:36.737063 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-72aad59f-1473-4b52-aec6-5e4dbf4a0ead tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:36.737511 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-72aad59f-1473-4b52-aec6-5e4dbf4a0ead tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:36.738864 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-72aad59f-1473-4b52-aec6-5e4dbf4a0ead tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:36.739299 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-72aad59f-1473-4b52-aec6-5e4dbf4a0ead tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:37.093884 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-72aad59f-1473-4b52-aec6-5e4dbf4a0ead tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "POST /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370695 Aug 03 12:17:37.094512 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 413/789] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:17:36 2022] POST /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:17:37.136239 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-af1f38c5-0a9b-4eee-9dfe-404d00d4cc1f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:37.136868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-af1f38c5-0a9b-4eee-9dfe-404d00d4cc1f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:37.148620 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-af1f38c5-0a9b-4eee-9dfe-404d00d4cc1f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:37.149065 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-af1f38c5-0a9b-4eee-9dfe-404d00d4cc1f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:37.150005 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-af1f38c5-0a9b-4eee-9dfe-404d00d4cc1f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:37.150848 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-af1f38c5-0a9b-4eee-9dfe-404d00d4cc1f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:37.373481 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-af1f38c5-0a9b-4eee-9dfe-404d00d4cc1f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:37.381554 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-af1f38c5-0a9b-4eee-9dfe-404d00d4cc1f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:37.383277 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-af1f38c5-0a9b-4eee-9dfe-404d00d4cc1f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:37.384648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-af1f38c5-0a9b-4eee-9dfe-404d00d4cc1f tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.252480 Aug 03 12:17:37.385245 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 377/790] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:37 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:38.412174 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-6847dcf4-0e40-489f-8c5c-0a15b6262353 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:38.413582 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-6847dcf4-0e40-489f-8c5c-0a15b6262353 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:38.421489 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6847dcf4-0e40-489f-8c5c-0a15b6262353 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:38.422170 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6847dcf4-0e40-489f-8c5c-0a15b6262353 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:38.422952 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6847dcf4-0e40-489f-8c5c-0a15b6262353 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:38.423370 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-6847dcf4-0e40-489f-8c5c-0a15b6262353 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:38.586061 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6847dcf4-0e40-489f-8c5c-0a15b6262353 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:38.595231 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6847dcf4-0e40-489f-8c5c-0a15b6262353 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:38.596770 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-6847dcf4-0e40-489f-8c5c-0a15b6262353 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:38.598057 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-6847dcf4-0e40-489f-8c5c-0a15b6262353 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.192033 Aug 03 12:17:38.598669 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 414/791] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:38 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:39.621109 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-713b98d6-85fc-46c1-b9b9-0447388ebfaa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:39.621783 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-713b98d6-85fc-46c1-b9b9-0447388ebfaa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:39.629067 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-713b98d6-85fc-46c1-b9b9-0447388ebfaa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:39.630157 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-713b98d6-85fc-46c1-b9b9-0447388ebfaa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:39.630962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-713b98d6-85fc-46c1-b9b9-0447388ebfaa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:39.631397 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-713b98d6-85fc-46c1-b9b9-0447388ebfaa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:39.784888 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-713b98d6-85fc-46c1-b9b9-0447388ebfaa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:39.797879 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-713b98d6-85fc-46c1-b9b9-0447388ebfaa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:39.799513 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-713b98d6-85fc-46c1-b9b9-0447388ebfaa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:39.800735 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-713b98d6-85fc-46c1-b9b9-0447388ebfaa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.183600 Aug 03 12:17:39.801814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 378/792] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:39 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:40.830123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-de48a56b-b1b7-4722-9edc-8dca894b9cfa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:40.831676 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-de48a56b-b1b7-4722-9edc-8dca894b9cfa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:40.840136 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-de48a56b-b1b7-4722-9edc-8dca894b9cfa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:40.840618 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-de48a56b-b1b7-4722-9edc-8dca894b9cfa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:40.841671 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-de48a56b-b1b7-4722-9edc-8dca894b9cfa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:40.842366 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-de48a56b-b1b7-4722-9edc-8dca894b9cfa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:41.018747 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-de48a56b-b1b7-4722-9edc-8dca894b9cfa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:41.028637 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-de48a56b-b1b7-4722-9edc-8dca894b9cfa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:41.030397 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-de48a56b-b1b7-4722-9edc-8dca894b9cfa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:41.031716 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-de48a56b-b1b7-4722-9edc-8dca894b9cfa tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.206027 Aug 03 12:17:41.032791 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 415/793] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:40 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:17:42.067967 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-790f61fa-6a2d-4d92-9e3e-0d0e4c16d647 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:42.068705 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-790f61fa-6a2d-4d92-9e3e-0d0e4c16d647 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:42.071592 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=50 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:42.077277 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-790f61fa-6a2d-4d92-9e3e-0d0e4c16d647 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:42.077757 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-790f61fa-6a2d-4d92-9e3e-0d0e4c16d647 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:42.078571 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-790f61fa-6a2d-4d92-9e3e-0d0e4c16d647 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:42.079055 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-790f61fa-6a2d-4d92-9e3e-0d0e4c16d647 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:42.235347 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-790f61fa-6a2d-4d92-9e3e-0d0e4c16d647 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:42.248543 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-790f61fa-6a2d-4d92-9e3e-0d0e4c16d647 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:42.250283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-790f61fa-6a2d-4d92-9e3e-0d0e4c16d647 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:42.251542 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-790f61fa-6a2d-4d92-9e3e-0d0e4c16d647 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.187782 Aug 03 12:17:42.252327 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 379/794] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:42 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:43.276566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b20df09f-738d-440f-a02d-a554aca4dbd2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:43.277277 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b20df09f-738d-440f-a02d-a554aca4dbd2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:43.284645 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b20df09f-738d-440f-a02d-a554aca4dbd2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:43.285090 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b20df09f-738d-440f-a02d-a554aca4dbd2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:43.286669 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b20df09f-738d-440f-a02d-a554aca4dbd2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:43.287234 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b20df09f-738d-440f-a02d-a554aca4dbd2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:43.438860 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b20df09f-738d-440f-a02d-a554aca4dbd2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:43.447682 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b20df09f-738d-440f-a02d-a554aca4dbd2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:43.449533 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b20df09f-738d-440f-a02d-a554aca4dbd2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:43.450827 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b20df09f-738d-440f-a02d-a554aca4dbd2 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.178280 Aug 03 12:17:43.451654 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 416/795] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:43 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:44.476904 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7ec43af4-2983-43ca-9a3a-350fc75a7195 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:44.477532 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7ec43af4-2983-43ca-9a3a-350fc75a7195 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:44.484848 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7ec43af4-2983-43ca-9a3a-350fc75a7195 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:44.485306 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7ec43af4-2983-43ca-9a3a-350fc75a7195 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:44.486084 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7ec43af4-2983-43ca-9a3a-350fc75a7195 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:44.486546 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7ec43af4-2983-43ca-9a3a-350fc75a7195 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:44.621990 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7ec43af4-2983-43ca-9a3a-350fc75a7195 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:44.631286 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7ec43af4-2983-43ca-9a3a-350fc75a7195 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:44.632837 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7ec43af4-2983-43ca-9a3a-350fc75a7195 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:44.634076 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7ec43af4-2983-43ca-9a3a-350fc75a7195 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.161436 Aug 03 12:17:44.634969 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 380/796] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:44 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:45.659466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-86c451dc-f042-4bcb-9622-4a3b411f2091 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:45.660174 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-86c451dc-f042-4bcb-9622-4a3b411f2091 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:45.666941 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-86c451dc-f042-4bcb-9622-4a3b411f2091 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:45.667468 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-86c451dc-f042-4bcb-9622-4a3b411f2091 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:45.668308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-86c451dc-f042-4bcb-9622-4a3b411f2091 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:45.668809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-86c451dc-f042-4bcb-9622-4a3b411f2091 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:45.820743 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-86c451dc-f042-4bcb-9622-4a3b411f2091 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:45.829485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-86c451dc-f042-4bcb-9622-4a3b411f2091 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:45.831307 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-86c451dc-f042-4bcb-9622-4a3b411f2091 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:45.833201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-86c451dc-f042-4bcb-9622-4a3b411f2091 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.177051 Aug 03 12:17:45.834109 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 417/797] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:45 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:46.856203 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-13c3d189-390b-432b-bdfa-ca3d8da35007 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:46.856812 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-13c3d189-390b-432b-bdfa-ca3d8da35007 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:46.864913 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-13c3d189-390b-432b-bdfa-ca3d8da35007 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:46.865375 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-13c3d189-390b-432b-bdfa-ca3d8da35007 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:46.866123 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-13c3d189-390b-432b-bdfa-ca3d8da35007 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:46.866578 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-13c3d189-390b-432b-bdfa-ca3d8da35007 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:47.006816 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-13c3d189-390b-432b-bdfa-ca3d8da35007 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:47.015297 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-13c3d189-390b-432b-bdfa-ca3d8da35007 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:47.016805 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-13c3d189-390b-432b-bdfa-ca3d8da35007 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:47.018018 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-13c3d189-390b-432b-bdfa-ca3d8da35007 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.165931 Aug 03 12:17:47.018596 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 381/798] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:46 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:48.040994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cf41f14f-d6c4-40a8-9089-6090dbbd65e5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:48.041610 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cf41f14f-d6c4-40a8-9089-6090dbbd65e5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:48.048567 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cf41f14f-d6c4-40a8-9089-6090dbbd65e5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:48.049092 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cf41f14f-d6c4-40a8-9089-6090dbbd65e5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:48.049805 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cf41f14f-d6c4-40a8-9089-6090dbbd65e5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:48.050243 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cf41f14f-d6c4-40a8-9089-6090dbbd65e5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:48.200748 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cf41f14f-d6c4-40a8-9089-6090dbbd65e5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:48.210903 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cf41f14f-d6c4-40a8-9089-6090dbbd65e5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:48.212453 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cf41f14f-d6c4-40a8-9089-6090dbbd65e5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:48.213667 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cf41f14f-d6c4-40a8-9089-6090dbbd65e5 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.176598 Aug 03 12:17:48.214257 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 418/799] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:48 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:17:49.218630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d1caa4a9-7b30-4724-8f35-784e98062133 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:49.219211 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d1caa4a9-7b30-4724-8f35-784e98062133 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:49.226424 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d1caa4a9-7b30-4724-8f35-784e98062133 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:49.226899 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d1caa4a9-7b30-4724-8f35-784e98062133 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:49.227671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d1caa4a9-7b30-4724-8f35-784e98062133 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:49.228137 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d1caa4a9-7b30-4724-8f35-784e98062133 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:49.238093 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-996be7f5-6436-4b00-a782-4e344cd4bdc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:49.239585 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-996be7f5-6436-4b00-a782-4e344cd4bdc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:49.247943 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-996be7f5-6436-4b00-a782-4e344cd4bdc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:49.248393 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-996be7f5-6436-4b00-a782-4e344cd4bdc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:49.249199 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-996be7f5-6436-4b00-a782-4e344cd4bdc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:49.249675 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-996be7f5-6436-4b00-a782-4e344cd4bdc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:49.254136 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:49.328561 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-d1caa4a9-7b30-4724-8f35-784e98062133 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lazy-loading 'services' on Instance uuid cad9eeba-c0de-4b84-94ca-4a6a2253ea09 {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:17:49.397440 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-996be7f5-6436-4b00-a782-4e344cd4bdc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:49.408492 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-996be7f5-6436-4b00-a782-4e344cd4bdc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:49.409656 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d1caa4a9-7b30-4724-8f35-784e98062133 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09/os-volume_attachments/3518e42e-99b1-4fbf-9319-6fd95fe7663e" status: 202 len: 0 microversion: 2.1 time: 0.194671 Aug 03 12:17:49.410057 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-996be7f5-6436-4b00-a782-4e344cd4bdc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:49.411622 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 382/800] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 3 12:17:49 2022] DELETE /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09/os-volume_attachments/3518e42e-99b1-4fbf-9319-6fd95fe7663e => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 12:17:49.411991 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-996be7f5-6436-4b00-a782-4e344cd4bdc4 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.177757 Aug 03 12:17:49.412655 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 419/801] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:49 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:17:49.421613 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-abe1dca6-04d4-4c0f-92ce-2dcaebf9faa0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:49.424452 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-abe1dca6-04d4-4c0f-92ce-2dcaebf9faa0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:49.431360 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-abe1dca6-04d4-4c0f-92ce-2dcaebf9faa0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:49.431811 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-abe1dca6-04d4-4c0f-92ce-2dcaebf9faa0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:49.432599 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-abe1dca6-04d4-4c0f-92ce-2dcaebf9faa0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:49.433044 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-abe1dca6-04d4-4c0f-92ce-2dcaebf9faa0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:49.469738 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-abe1dca6-04d4-4c0f-92ce-2dcaebf9faa0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053196 Aug 03 12:17:49.470332 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 383/802] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:17:49 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:17:50.436337 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d66a2c29-1ca3-46ae-9fcf-bb0b0d976948 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:50.437125 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d66a2c29-1ca3-46ae-9fcf-bb0b0d976948 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:50.442710 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-e3443071-3c30-4d31-a983-53f2a59166a3 req-8458a096-1849-41bf-8797-852dc6704d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5335f69-42aa-4fcf-8ee9-223f8e1485ec", "name": "network-vif-plugged", "status": "completed", "tag": "02cf3d48-0345-435e-ba69-48f06b2d3b86"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:50.445609 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d66a2c29-1ca3-46ae-9fcf-bb0b0d976948 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:50.446505 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d66a2c29-1ca3-46ae-9fcf-bb0b0d976948 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:50.447661 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d66a2c29-1ca3-46ae-9fcf-bb0b0d976948 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:50.448102 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d66a2c29-1ca3-46ae-9fcf-bb0b0d976948 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:50.464911 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-e3443071-3c30-4d31-a983-53f2a59166a3 req-8458a096-1849-41bf-8797-852dc6704d17 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:50.465671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-e3443071-3c30-4d31-a983-53f2a59166a3 req-8458a096-1849-41bf-8797-852dc6704d17 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:50.617323 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d66a2c29-1ca3-46ae-9fcf-bb0b0d976948 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:50.626639 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d66a2c29-1ca3-46ae-9fcf-bb0b0d976948 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:50.629596 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-d66a2c29-1ca3-46ae-9fcf-bb0b0d976948 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:50.631947 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d66a2c29-1ca3-46ae-9fcf-bb0b0d976948 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.199515 Aug 03 12:17:50.632954 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 420/803] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:50 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:50.639227 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2d1af39e-2085-4216-b8c8-9bc3ab65a9c0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:50.641641 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2d1af39e-2085-4216-b8c8-9bc3ab65a9c0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:50.649176 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d1af39e-2085-4216-b8c8-9bc3ab65a9c0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:50.649515 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-e3443071-3c30-4d31-a983-53f2a59166a3 req-8458a096-1849-41bf-8797-852dc6704d17 service nova] Creating event network-vif-plugged:02cf3d48-0345-435e-ba69-48f06b2d3b86 for instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec on hv-cinder-83602 Aug 03 12:17:50.649628 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d1af39e-2085-4216-b8c8-9bc3ab65a9c0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:50.650416 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d1af39e-2085-4216-b8c8-9bc3ab65a9c0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:50.650982 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2d1af39e-2085-4216-b8c8-9bc3ab65a9c0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:50.654848 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-e3443071-3c30-4d31-a983-53f2a59166a3 req-8458a096-1849-41bf-8797-852dc6704d17 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217359 Aug 03 12:17:50.655752 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 384/804] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:17:50.687149 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2d1af39e-2085-4216-b8c8-9bc3ab65a9c0 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052166 Aug 03 12:17:50.687867 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 421/805] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:17:50 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 12:17:50.778244 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ee44e4e8-4a00-414e-a346-00419028c3ca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:50.778837 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-ee44e4e8-4a00-414e-a346-00419028c3ca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:50.786368 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ee44e4e8-4a00-414e-a346-00419028c3ca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:50.786890 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ee44e4e8-4a00-414e-a346-00419028c3ca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:50.787660 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ee44e4e8-4a00-414e-a346-00419028c3ca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:50.788102 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ee44e4e8-4a00-414e-a346-00419028c3ca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:50.818311 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-ee44e4e8-4a00-414e-a346-00419028c3ca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Going to try to terminate instance {{(pid=117911) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:17:50.835884 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:17:50.915156 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ee44e4e8-4a00-414e-a346-00419028c3ca tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 204 len: 0 microversion: 2.1 time: 0.140933 Aug 03 12:17:50.916171 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 385/806] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:17:50 2022] DELETE /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 12:17:50.928472 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a97fbc81-8b9d-4d53-94fb-f3e678fc0236 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:50.929470 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a97fbc81-8b9d-4d53-94fb-f3e678fc0236 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:50.936335 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a97fbc81-8b9d-4d53-94fb-f3e678fc0236 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:50.936907 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a97fbc81-8b9d-4d53-94fb-f3e678fc0236 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:50.937765 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a97fbc81-8b9d-4d53-94fb-f3e678fc0236 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:50.938271 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a97fbc81-8b9d-4d53-94fb-f3e678fc0236 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:51.096288 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a97fbc81-8b9d-4d53-94fb-f3e678fc0236 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:51.104807 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a97fbc81-8b9d-4d53-94fb-f3e678fc0236 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1682 microversion: 2.1 time: 0.183519 Aug 03 12:17:51.105413 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 422/807] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:50 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:51.672859 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-75f3478b-2120-40da-8081-f48cc7441b05 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:51.673963 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-75f3478b-2120-40da-8081-f48cc7441b05 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:51.681829 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-75f3478b-2120-40da-8081-f48cc7441b05 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:51.682270 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-75f3478b-2120-40da-8081-f48cc7441b05 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:51.683099 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-75f3478b-2120-40da-8081-f48cc7441b05 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:51.683532 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-75f3478b-2120-40da-8081-f48cc7441b05 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:51.834864 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-75f3478b-2120-40da-8081-f48cc7441b05 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:51.843573 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-75f3478b-2120-40da-8081-f48cc7441b05 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:51.845125 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-75f3478b-2120-40da-8081-f48cc7441b05 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:51.846352 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-75f3478b-2120-40da-8081-f48cc7441b05 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.178016 Aug 03 12:17:51.846972 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 386/808] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:51 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:52.126532 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b830af65-cf86-4ad5-82df-c9374ecdd867 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:52.127063 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b830af65-cf86-4ad5-82df-c9374ecdd867 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:52.134648 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b830af65-cf86-4ad5-82df-c9374ecdd867 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:52.135112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b830af65-cf86-4ad5-82df-c9374ecdd867 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:52.135891 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b830af65-cf86-4ad5-82df-c9374ecdd867 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:52.136456 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b830af65-cf86-4ad5-82df-c9374ecdd867 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:52.283664 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b830af65-cf86-4ad5-82df-c9374ecdd867 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:52.291716 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b830af65-cf86-4ad5-82df-c9374ecdd867 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1682 microversion: 2.1 time: 0.169101 Aug 03 12:17:52.292312 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 423/809] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:52 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:52.870782 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e52621ce-43fc-4a8b-a9d4-05dace3dc450 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:52.871388 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e52621ce-43fc-4a8b-a9d4-05dace3dc450 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:52.878017 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e52621ce-43fc-4a8b-a9d4-05dace3dc450 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:52.878487 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e52621ce-43fc-4a8b-a9d4-05dace3dc450 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:52.879340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e52621ce-43fc-4a8b-a9d4-05dace3dc450 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:52.879774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e52621ce-43fc-4a8b-a9d4-05dace3dc450 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:53.109061 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e52621ce-43fc-4a8b-a9d4-05dace3dc450 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:53.119722 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e52621ce-43fc-4a8b-a9d4-05dace3dc450 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:53.121796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e52621ce-43fc-4a8b-a9d4-05dace3dc450 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:53.123427 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e52621ce-43fc-4a8b-a9d4-05dace3dc450 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.256737 Aug 03 12:17:53.124092 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 387/810] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:52 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:53.315124 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ad85175a-5ad7-4829-b482-7eb485095a56 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:53.315957 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ad85175a-5ad7-4829-b482-7eb485095a56 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:53.322869 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ad85175a-5ad7-4829-b482-7eb485095a56 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:53.323317 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ad85175a-5ad7-4829-b482-7eb485095a56 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:53.324096 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ad85175a-5ad7-4829-b482-7eb485095a56 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:53.324532 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ad85175a-5ad7-4829-b482-7eb485095a56 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:53.483098 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ad85175a-5ad7-4829-b482-7eb485095a56 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:53.492890 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ad85175a-5ad7-4829-b482-7eb485095a56 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1682 microversion: 2.1 time: 0.183300 Aug 03 12:17:53.493640 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 424/811] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:53 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:54.037747 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-4d01fce3-4d73-41fd-bcba-05a60879fd45 req-7668dd54-c16e-4af6-a496-4be036451252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad9eeba-c0de-4b84-94ca-4a6a2253ea09", "name": "network-vif-deleted", "tag": "3ef595c4-cb1e-4ae4-b2b5-8ced39865114"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:17:54.091178 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-4d01fce3-4d73-41fd-bcba-05a60879fd45 req-7668dd54-c16e-4af6-a496-4be036451252 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:54.091958 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-4d01fce3-4d73-41fd-bcba-05a60879fd45 req-7668dd54-c16e-4af6-a496-4be036451252 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:54.129832 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-4d01fce3-4d73-41fd-bcba-05a60879fd45 req-7668dd54-c16e-4af6-a496-4be036451252 service nova] Creating event network-vif-deleted:3ef595c4-cb1e-4ae4-b2b5-8ced39865114 for instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 on hv-cinder-83602 Aug 03 12:17:54.144263 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-4d01fce3-4d73-41fd-bcba-05a60879fd45 req-7668dd54-c16e-4af6-a496-4be036451252 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112906 Aug 03 12:17:54.147148 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 388/812] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:17:54.163711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ce5da6e4-7ee7-4af6-8f8d-1b2672f1358b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:54.167994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ce5da6e4-7ee7-4af6-8f8d-1b2672f1358b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:54.186251 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ce5da6e4-7ee7-4af6-8f8d-1b2672f1358b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:54.188970 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ce5da6e4-7ee7-4af6-8f8d-1b2672f1358b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:54.190812 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ce5da6e4-7ee7-4af6-8f8d-1b2672f1358b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:54.192402 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ce5da6e4-7ee7-4af6-8f8d-1b2672f1358b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:54.451287 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ce5da6e4-7ee7-4af6-8f8d-1b2672f1358b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:54.470832 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ce5da6e4-7ee7-4af6-8f8d-1b2672f1358b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:54.475571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ce5da6e4-7ee7-4af6-8f8d-1b2672f1358b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:54.483629 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ce5da6e4-7ee7-4af6-8f8d-1b2672f1358b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1730 microversion: 2.20 time: 0.331427 Aug 03 12:17:54.485338 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 425/813] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:54 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1730 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:17:54.528221 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-9d72a217-2ca3-4da0-a5ba-d2687ab19026 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:54.531249 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-9d72a217-2ca3-4da0-a5ba-d2687ab19026 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:54.540511 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9d72a217-2ca3-4da0-a5ba-d2687ab19026 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:54.541261 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9d72a217-2ca3-4da0-a5ba-d2687ab19026 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:54.542331 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9d72a217-2ca3-4da0-a5ba-d2687ab19026 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:54.543072 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9d72a217-2ca3-4da0-a5ba-d2687ab19026 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:54.580667 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9d72a217-2ca3-4da0-a5ba-d2687ab19026 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:54.581271 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9d72a217-2ca3-4da0-a5ba-d2687ab19026 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:54.581968 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-9d72a217-2ca3-4da0-a5ba-d2687ab19026 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lazy-loading 'fault' on Instance uuid cad9eeba-c0de-4b84-94ca-4a6a2253ea09 {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:17:54.631930 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-9d72a217-2ca3-4da0-a5ba-d2687ab19026 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7566583228946488bd1ab647bbe8059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bd0b93ac8140559e3ddfe51cc2cdaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:54.648646 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-9d72a217-2ca3-4da0-a5ba-d2687ab19026 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 200 len: 1331 microversion: 2.1 time: 0.124106 Aug 03 12:17:54.650052 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 389/814] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:54 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:17:55.523854 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-dcab5f13-c471-40a0-8a1f-60e4a44d3a01 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:55.525005 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-dcab5f13-c471-40a0-8a1f-60e4a44d3a01 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:55.534334 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dcab5f13-c471-40a0-8a1f-60e4a44d3a01 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:55.535511 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dcab5f13-c471-40a0-8a1f-60e4a44d3a01 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:55.536686 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dcab5f13-c471-40a0-8a1f-60e4a44d3a01 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:55.537204 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dcab5f13-c471-40a0-8a1f-60e4a44d3a01 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:55.682133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-dcab5f13-c471-40a0-8a1f-60e4a44d3a01 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:55.682533 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1478dddd-fbcf-46ce-8deb-d34e3978f853 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:55.683161 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1478dddd-fbcf-46ce-8deb-d34e3978f853 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:55.689663 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1478dddd-fbcf-46ce-8deb-d34e3978f853 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:55.690108 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1478dddd-fbcf-46ce-8deb-d34e3978f853 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:55.690493 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-dcab5f13-c471-40a0-8a1f-60e4a44d3a01 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:55.691266 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1478dddd-fbcf-46ce-8deb-d34e3978f853 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:55.692361 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1478dddd-fbcf-46ce-8deb-d34e3978f853 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:55.692650 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-dcab5f13-c471-40a0-8a1f-60e4a44d3a01 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:17:55.693832 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-dcab5f13-c471-40a0-8a1f-60e4a44d3a01 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1717 microversion: 2.20 time: 0.176294 Aug 03 12:17:55.694399 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 426/815] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:17:55 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1717 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:17:55.706532 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-1478dddd-fbcf-46ce-8deb-d34e3978f853 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1478dddd-fbcf-46ce-8deb-d34e3978f853 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 HTTP/1.1 Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:17:55.709790 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:17:55.712892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:17:55.712892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:55.712892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:55.712892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:55.712892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:55.712892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:17:55.712892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:17:55.712892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:17:55.712892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:55.712892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:17:55.712892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:55.712892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'cad9eeba-c0de-4b84-94ca-4a6a2253ea09'} Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:17:55.714774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:55.716346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:55.717685 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1478dddd-fbcf-46ce-8deb-d34e3978f853 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 404 to user: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:17:55.717685 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1478dddd-fbcf-46ce-8deb-d34e3978f853 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 404 len: 111 microversion: 2.1 time: 0.031038 Aug 03 12:17:55.717685 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 390/816] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:55 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 12:17:55.718632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b90cc59a-721e-4862-8b9f-cf89674c5cd3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '.version_select at 0x7f14d6f5be50>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:55.739813 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b90cc59a-721e-4862-8b9f-cf89674c5cd3 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088793282" status: 202 len: 0 microversion: 2.1 time: 0.024929 Aug 03 12:17:55.740393 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 427/817] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 3 12:17:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088793282 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:17:57.604442 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d4df8aa9-4b31-49fb-86db-a08ba4390d55 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:57.605021 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d4df8aa9-4b31-49fb-86db-a08ba4390d55 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:57.616471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d4df8aa9-4b31-49fb-86db-a08ba4390d55 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:57.617031 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d4df8aa9-4b31-49fb-86db-a08ba4390d55 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:57.617944 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d4df8aa9-4b31-49fb-86db-a08ba4390d55 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:57.618521 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d4df8aa9-4b31-49fb-86db-a08ba4390d55 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:57.646405 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-d4df8aa9-4b31-49fb-86db-a08ba4390d55 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d4df8aa9-4b31-49fb-86db-a08ba4390d55 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: DELETE /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 HTTP/1.1 Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:17:57.649473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:17:57.651135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:17:57.651135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:57.651135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:57.651135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:57.651135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:57.651135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:17:57.651135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:17:57.651135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:17:57.651135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:57.651135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:17:57.651135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:57.651135 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'cad9eeba-c0de-4b84-94ca-4a6a2253ea09'} Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:17:57.652019 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:57.653429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:57.654831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d4df8aa9-4b31-49fb-86db-a08ba4390d55 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 404 to user: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:17:57.654831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d4df8aa9-4b31-49fb-86db-a08ba4390d55 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 404 len: 111 microversion: 2.1 time: 0.052402 Aug 03 12:17:57.654831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 391/818] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:17:57 2022] DELETE /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:17:57.665785 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-63a86c4a-a4d2-41e2-b46f-fa4f5068a366 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:57.666659 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-63a86c4a-a4d2-41e2-b46f-fa4f5068a366 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: cad9eeba-c0de-4b84-94ca-4a6a2253ea09] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:57.679634 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-63a86c4a-a4d2-41e2-b46f-fa4f5068a366 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:57.680410 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-63a86c4a-a4d2-41e2-b46f-fa4f5068a366 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:57.681800 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-63a86c4a-a4d2-41e2-b46f-fa4f5068a366 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:57.682592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-63a86c4a-a4d2-41e2-b46f-fa4f5068a366 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:57.711161 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-63a86c4a-a4d2-41e2-b46f-fa4f5068a366 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-63a86c4a-a4d2-41e2-b46f-fa4f5068a366 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 HTTP/1.1 Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:17:57.713232 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:17:57.716139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:17:57.716139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:57.716139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:57.716139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:57.716139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:57.716139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:17:57.716139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:17:57.716139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:17:57.716139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:57.716139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:17:57.716139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:57.716139 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'cad9eeba-c0de-4b84-94ca-4a6a2253ea09'} Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:17:57.717433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. Aug 03 12:17:57.719717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:57.721723 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-63a86c4a-a4d2-41e2-b46f-fa4f5068a366 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 404 to user: Instance cad9eeba-c0de-4b84-94ca-4a6a2253ea09 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:17:57.721723 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-63a86c4a-a4d2-41e2-b46f-fa4f5068a366 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09" status: 404 len: 111 microversion: 2.1 time: 0.056667 Aug 03 12:17:57.721723 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 428/819] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:57 2022] GET /compute/v2.1/servers/cad9eeba-c0de-4b84-94ca-4a6a2253ea09 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:17:58.884000 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-04574c79-603b-4ad8-9234-98cd3f480706 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:58.884872 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-04574c79-603b-4ad8-9234-98cd3f480706 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:58.892389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-04574c79-603b-4ad8-9234-98cd3f480706 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:58.892836 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-04574c79-603b-4ad8-9234-98cd3f480706 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:58.893644 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-04574c79-603b-4ad8-9234-98cd3f480706 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:58.894082 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-04574c79-603b-4ad8-9234-98cd3f480706 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:58.911171 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-04574c79-603b-4ad8-9234-98cd3f480706 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-04574c79-603b-4ad8-9234-98cd3f480706 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: DELETE /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a HTTP/1.1 Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:17:58.912773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:17:58.915519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:17:58.915519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:58.915519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:58.915519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:58.915519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:58.915519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:17:58.915519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:17:58.915519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:17:58.915519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:58.915519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:17:58.915519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:17:58.915519 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a'} Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:17:58.917147 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:17:58.919724 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:58.922558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-04574c79-603b-4ad8-9234-98cd3f480706 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 404 to user: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:17:58.922558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-04574c79-603b-4ad8-9234-98cd3f480706 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 404 len: 111 microversion: 2.1 time: 0.036125 Aug 03 12:17:58.922558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 392/820] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:17:58 2022] DELETE /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:17:58.925403 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e8895997-0320-471c-ba4b-cdbd15f705f6 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:58.926214 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e8895997-0320-471c-ba4b-cdbd15f705f6 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:58.934555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e8895997-0320-471c-ba4b-cdbd15f705f6 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:58.935026 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e8895997-0320-471c-ba4b-cdbd15f705f6 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:58.935893 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e8895997-0320-471c-ba4b-cdbd15f705f6 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:58.936391 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e8895997-0320-471c-ba4b-cdbd15f705f6 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:58.953550 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-e8895997-0320-471c-ba4b-cdbd15f705f6 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e8895997-0320-471c-ba4b-cdbd15f705f6 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a HTTP/1.1 Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:17:58.955455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:17:58.958948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:17:58.958948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:58.958948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:58.958948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:58.958948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:58.958948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:17:58.958948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:17:58.958948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:17:58.958948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:58.958948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:17:58.958948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:17:58.958948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a'} Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:17:58.960241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. Aug 03 12:17:58.962570 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:58.965916 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e8895997-0320-471c-ba4b-cdbd15f705f6 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 404 to user: Instance afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:17:58.965916 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e8895997-0320-471c-ba4b-cdbd15f705f6 tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a" status: 404 len: 111 microversion: 2.1 time: 0.039049 Aug 03 12:17:58.965916 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 429/821] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:58 2022] GET /compute/v2.1/servers/afb08aa6-513e-401d-a8b7-2c2cbc2e1f2a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:17:58.970410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5f3e6604-84a5-4502-8252-229ecfedacdf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:58.971050 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5f3e6604-84a5-4502-8252-229ecfedacdf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:58.977774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5f3e6604-84a5-4502-8252-229ecfedacdf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:58.978228 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5f3e6604-84a5-4502-8252-229ecfedacdf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:58.979086 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5f3e6604-84a5-4502-8252-229ecfedacdf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:58.979530 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5f3e6604-84a5-4502-8252-229ecfedacdf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:58.996396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-5f3e6604-84a5-4502-8252-229ecfedacdf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5f3e6604-84a5-4502-8252-229ecfedacdf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: DELETE /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf HTTP/1.1 Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:17:58.998359 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:17:59.001150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:17:59.001150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:59.001150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:59.001150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:59.001150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:59.001150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:17:59.001150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:17:59.001150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:17:59.001150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:59.001150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:17:59.001150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:17:59.001150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': '2776d6e3-3b32-4548-828f-cc640cc445bf'} Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:17:59.002711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:17:59.005962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:17:59.008311 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5f3e6604-84a5-4502-8252-229ecfedacdf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 404 to user: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:17:59.008311 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5f3e6604-84a5-4502-8252-229ecfedacdf tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 404 len: 111 microversion: 2.1 time: 0.035015 Aug 03 12:17:59.008311 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 393/822] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:17:58 2022] DELETE /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 12:17:59.014780 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b3360431-180b-49c1-aef6-42ebc947685b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:17:59.015524 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b3360431-180b-49c1-aef6-42ebc947685b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: 2776d6e3-3b32-4548-828f-cc640cc445bf] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:17:59.024539 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b3360431-180b-49c1-aef6-42ebc947685b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:59.025217 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b3360431-180b-49c1-aef6-42ebc947685b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:59.026188 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b3360431-180b-49c1-aef6-42ebc947685b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:17:59.026742 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b3360431-180b-49c1-aef6-42ebc947685b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:17:59.045110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-b3360431-180b-49c1-aef6-42ebc947685b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b3360431-180b-49c1-aef6-42ebc947685b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf HTTP/1.1 Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:17:59.046709 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:17:59.049242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:17:59.049242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:59.049242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:17:59.049242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:17:59.049242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:59.049242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:17:59.049242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:17:59.049242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:17:59.049242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:17:59.049242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:17:59.049242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:17:59.049242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': '2776d6e3-3b32-4548-828f-cc640cc445bf'} Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:17:59.050816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. Aug 03 12:17:59.053113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:17:59.055126 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b3360431-180b-49c1-aef6-42ebc947685b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 404 to user: Instance 2776d6e3-3b32-4548-828f-cc640cc445bf could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:17:59.055126 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b3360431-180b-49c1-aef6-42ebc947685b tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf" status: 404 len: 111 microversion: 2.1 time: 0.038023 Aug 03 12:17:59.055126 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 430/823] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:17:59 2022] GET /compute/v2.1/servers/2776d6e3-3b32-4548-828f-cc640cc445bf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:18:00.223610 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1d09806e-5c69-4fac-9482-0a180ac2689f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:00.224396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1d09806e-5c69-4fac-9482-0a180ac2689f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:00.236264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1d09806e-5c69-4fac-9482-0a180ac2689f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:00.237168 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1d09806e-5c69-4fac-9482-0a180ac2689f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:00.239171 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1d09806e-5c69-4fac-9482-0a180ac2689f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:00.239979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1d09806e-5c69-4fac-9482-0a180ac2689f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:00.267502 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-1d09806e-5c69-4fac-9482-0a180ac2689f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1d09806e-5c69-4fac-9482-0a180ac2689f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: DELETE /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 HTTP/1.1 Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:18:00.270781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:18:00.272340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:00.272340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:18:00.272340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:18:00.272340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:18:00.272340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:18:00.272340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:18:00.272340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:18:00.272340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:18:00.272340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:18:00.272340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:18:00.272340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:18:00.272340 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'fedea0ca-7f85-49dc-8459-160418843f05'} Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:00.273182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:18:00.274496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:00.275665 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1d09806e-5c69-4fac-9482-0a180ac2689f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 404 to user: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:00.275665 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1d09806e-5c69-4fac-9482-0a180ac2689f tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 404 len: 111 microversion: 2.1 time: 0.057136 Aug 03 12:18:00.275665 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 394/824] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:18:00 2022] DELETE /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:18:00.284009 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-93d99e8a-df36-4677-afb2-34173d3b382a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:00.284640 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-93d99e8a-df36-4677-afb2-34173d3b382a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] [instance: fedea0ca-7f85-49dc-8459-160418843f05] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:00.292350 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-93d99e8a-df36-4677-afb2-34173d3b382a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:00.292809 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-93d99e8a-df36-4677-afb2-34173d3b382a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:00.293674 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-93d99e8a-df36-4677-afb2-34173d3b382a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:00.294162 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-93d99e8a-df36-4677-afb2-34173d3b382a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:00.318099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-93d99e8a-df36-4677-afb2-34173d3b382a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] HTTP exception thrown: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-93d99e8a-df36-4677-afb2-34173d3b382a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Request method failure captured: Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 HTTP/1.1 Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXd6402eP6pZfzc4Ecc3DZL5LCEJWizECdWaao4pFeALyRHlsdH92jWBU6BHB5EcdJYJc-QcFFwi1UQ_8EqmB_e2ImMrUeJTL9-XR51tTtSWkbNfsTLOlpnGAbtiXqm8QpjDtUWR8QJR1r3d3eP-4FNosykHbGw5zS5lHk5nds89XQ Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:18:00.321222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:18:00.323112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_04bd0b93ac8140559e3ddfe51cc2cdaf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/04bd0b93ac8140559e3ddfe51cc2cdaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:00.323112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:18:00.323112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 04bd0b93ac8140559e3ddfe51cc2cdaf Aug 03 12:18:00.323112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-975822329 Aug 03 12:18:00.323112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:18:00.323112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:18:00.323112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:18:00.323112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: e7566583228946488bd1ab647bbe8059 Aug 03 12:18:00.323112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeNegativeTest-975822329-project Aug 03 12:18:00.323112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:18:00.323112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:18:00.323112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'fedea0ca-7f85-49dc-8459-160418843f05'} Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:00.324044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. Aug 03 12:18:00.325373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:00.326409 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-93d99e8a-df36-4677-afb2-34173d3b382a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] Returning 404 to user: Instance fedea0ca-7f85-49dc-8459-160418843f05 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:00.326409 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-93d99e8a-df36-4677-afb2-34173d3b382a tempest-AttachVolumeNegativeTest-975822329 tempest-AttachVolumeNegativeTest-975822329-project] 10.222.0.17 "GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05" status: 404 len: 111 microversion: 2.1 time: 0.043636 Aug 03 12:18:00.326409 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 431/825] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:18:00 2022] GET /compute/v2.1/servers/fedea0ca-7f85-49dc-8459-160418843f05 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:18:02.136793 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5bbca2c0-1fa7-4b0f-9211-507d193ddc38 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:02.137473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5bbca2c0-1fa7-4b0f-9211-507d193ddc38 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:02.143922 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5bbca2c0-1fa7-4b0f-9211-507d193ddc38 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:02.144372 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5bbca2c0-1fa7-4b0f-9211-507d193ddc38 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:02.145483 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5bbca2c0-1fa7-4b0f-9211-507d193ddc38 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:02.145923 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5bbca2c0-1fa7-4b0f-9211-507d193ddc38 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:02.172517 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5bbca2c0-1fa7-4b0f-9211-507d193ddc38 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/ips" status: 200 len: 146 microversion: 2.1 time: 0.248442 Aug 03 12:18:02.173094 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 395/826] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 3 12:18:01 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/ips => generated 146 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:03.662823 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d059db47-f702-47f6-b9c6-a9f3c0b85c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce1b184a-fd42-4887-9f56-3ad288a2589a"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:18:03.672832 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d059db47-f702-47f6-b9c6-a9f3c0b85c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:03.689466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d059db47-f702-47f6-b9c6-a9f3c0b85c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:03.690642 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d059db47-f702-47f6-b9c6-a9f3c0b85c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:03.692660 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d059db47-f702-47f6-b9c6-a9f3c0b85c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:03.693237 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d059db47-f702-47f6-b9c6-a9f3c0b85c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:04.044287 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d059db47-f702-47f6-b9c6-a9f3c0b85c20 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "POST /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389244 Aug 03 12:18:04.044972 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 432/827] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:18:03 2022] POST /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:05.908567 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-64d9bab0-66fc-463f-85d0-16e5feff916f tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Action: 'create', calling method: .version_select at 0x7f14d6d54ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1435209480"}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:18:06.297819 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-64d9bab0-66fc-463f-85d0-16e5feff916f tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.524774 Aug 03 12:18:06.298426 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 396/828] 10.222.0.17 () {60 vars in 1155 bytes} [Wed Aug 3 12:18:05 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 526 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 03 12:18:06.312440 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-173dddc8-efb0-4543-9337-df71b1245fd2 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14dc089c10>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:06.373315 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-173dddc8-efb0-4543-9337-df71b1245fd2 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0" status: 200 len: 345 microversion: 2.1 time: 0.065144 Aug 03 12:18:06.373908 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 433/829] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 3 12:18:06 2022] GET /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:18:07.391775 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6c00f2da-233c-42f8-a647-a6aa07f7fe4e tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6de93a0>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:07.441690 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6c00f2da-233c-42f8-a647-a6aa07f7fe4e tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0" status: 200 len: 346 microversion: 2.1 time: 0.054336 Aug 03 12:18:07.442310 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 397/830] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 3 12:18:07 2022] GET /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:07.455794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9080f4ee-3f8b-4d65-bd12-c4be3ebcdb2a tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Action: 'create', calling method: .version_select at 0x7f14d6e4e670>, body: {"snapshot": {"volume_id": "e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-421173400"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:18:07.611828 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9080f4ee-3f8b-4d65-bd12-c4be3ebcdb2a tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.160474 Aug 03 12:18:07.612444 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 434/831] 10.222.0.17 () {60 vars in 1162 bytes} [Wed Aug 3 12:18:07 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:07.623497 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4b802b04-e729-4017-8db6-1d60a17c31e8 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6d54c10>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:07.656374 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-4b802b04-e729-4017-8db6-1d60a17c31e8 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d" status: 200 len: 286 microversion: 2.1 time: 0.037035 Aug 03 12:18:07.656939 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 398/832] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 3 12:18:07 2022] GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:07.668248 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d10e100a-0a72-4b3d-a2d3-6f9dfec428cc tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6e4e700>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:07.699323 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d10e100a-0a72-4b3d-a2d3-6f9dfec428cc tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034825 Aug 03 12:18:07.699901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 435/833] 10.222.0.17 () {58 vars in 1140 bytes} [Wed Aug 3 12:18:07 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:07.713543 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-46d191cd-3767-4601-b81e-3d9ca2d1aaed tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6cc8280>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:07.742833 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-46d191cd-3767-4601-b81e-3d9ca2d1aaed tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d" status: 200 len: 286 microversion: 2.1 time: 0.033259 Aug 03 12:18:07.743426 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 399/834] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 3 12:18:07 2022] GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:08.756762 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-df5ee3a2-baab-4698-a6c4-ae69834e91bd tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6e92dc0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:08.787479 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-df5ee3a2-baab-4698-a6c4-ae69834e91bd tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d" status: 200 len: 286 microversion: 2.1 time: 0.035540 Aug 03 12:18:08.788160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 436/835] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 3 12:18:08 2022] GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:09.800178 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-475f2272-f303-4c20-9bd2-0e265314efa3 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6d36d30>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:09.829889 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-475f2272-f303-4c20-9bd2-0e265314efa3 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d" status: 200 len: 286 microversion: 2.1 time: 0.033955 Aug 03 12:18:09.830505 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 400/836] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 3 12:18:09 2022] GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:10.844447 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a32d68ee-f34c-4201-874c-a0e28e92cafc tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6e59310>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:10.877732 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a32d68ee-f34c-4201-874c-a0e28e92cafc tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d" status: 200 len: 287 microversion: 2.1 time: 0.038745 Aug 03 12:18:10.878308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 437/837] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 3 12:18:10 2022] GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:10.890594 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b8f312df-9008-4f38-a79a-1e18f5a3bc10 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6d54af0>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:10.955402 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b8f312df-9008-4f38-a79a-1e18f5a3bc10 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d" status: 202 len: 0 microversion: 2.1 time: 0.069530 Aug 03 12:18:10.955967 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 401/838] 10.222.0.17 () {58 vars in 1254 bytes} [Wed Aug 3 12:18:10 2022] DELETE /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:18:10.964364 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2635bf33-ad11-42ce-b178-d5ccb47dd40a tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6e59a60>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:10.999681 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2635bf33-ad11-42ce-b178-d5ccb47dd40a tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d" status: 200 len: 286 microversion: 2.1 time: 0.039321 Aug 03 12:18:11.000308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 438/839] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 3 12:18:10 2022] GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:11.734325 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b69297d7-c781-4740-b026-2584c400f6ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:11.736498 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b69297d7-c781-4740-b026-2584c400f6ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:11.743501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b69297d7-c781-4740-b026-2584c400f6ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:11.743942 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b69297d7-c781-4740-b026-2584c400f6ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:11.744694 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b69297d7-c781-4740-b026-2584c400f6ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:11.745124 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b69297d7-c781-4740-b026-2584c400f6ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:11.775150 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b69297d7-c781-4740-b026-2584c400f6ac tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044986 Aug 03 12:18:11.775703 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 402/840] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:18:11 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:11.786359 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3f1c83db-9fea-4011-82ad-04f62485e720 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:11.787000 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3f1c83db-9fea-4011-82ad-04f62485e720 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:11.788948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:11.794519 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3f1c83db-9fea-4011-82ad-04f62485e720 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:11.794974 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3f1c83db-9fea-4011-82ad-04f62485e720 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:11.795735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3f1c83db-9fea-4011-82ad-04f62485e720 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:11.796179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3f1c83db-9fea-4011-82ad-04f62485e720 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:11.828175 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3f1c83db-9fea-4011-82ad-04f62485e720 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments/ce1b184a-fd42-4887-9f56-3ad288a2589a" status: 200 len: 194 microversion: 2.1 time: 0.045699 Aug 03 12:18:11.828805 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 439/841] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Aug 3 12:18:11 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments/ce1b184a-fd42-4887-9f56-3ad288a2589a => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:12.016804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-fbb7d093-a2c3-4ff2-a746-b1690466bd1e tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6d36dc0>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:12.047062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-fbb7d093-a2c3-4ff2-a746-b1690466bd1e tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] HTTP exception thrown: Snapshot 9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d could not be found. Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-fbb7d093-a2c3-4ff2-a746-b1690466bd1e tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Request method failure captured: Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d HTTP/1.1 Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6md9CLUug5AZr6Q3ZhJgy_CBKF5dieCdJyqB8cEpbSL0lNXKjrqKJr4EN4bPs-KYlMoeux0IAy_C22QNckEAZCq-gwGX6v1uFF7CTYCMc4o88BBPtMrpEoEXpxjGzeoOqIMLojmSIjA0FsGfBNd2aVNgRCmaV_s6PfP_B8u3FIpu2v8 Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: b828cda2aeff4145869b56c4f34e57b9 Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1799552980 Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:18:12.062472 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:18:12.063912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b828cda2aeff4145869b56c4f34e57b9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b828cda2aeff4145869b56c4f34e57b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b828cda2aeff4145869b56c4f34e57b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b828cda2aeff4145869b56c4f34e57b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:12.063912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1799552980 Aug 03 12:18:12.063912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: b828cda2aeff4145869b56c4f34e57b9 Aug 03 12:18:12.063912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1799552980 Aug 03 12:18:12.063912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-VolumesSnapshotsTestJSON-1799552980-project Aug 03 12:18:12.063912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:18:12.063912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:18:12.063912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: f0130953a68d4d8c9a739d9eb3f666f1 Aug 03 12:18:12.063912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1799552980-project Aug 03 12:18:12.063912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: Aug 03 12:18:12.063912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Snapshot 9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d could not be found. Aug 03 12:18:12.063912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': '9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d'} Aug 03 12:18:12.063912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d could not be found. (HTTP 404) (Request-ID: req-3d7cce93-8232-4c01-ada0-b0d9b3be5da0) Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:12.064861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:18:12.066183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d could not be found. Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 03 12:18:12.067569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:12.068961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d could not be found. Aug 03 12:18:12.068961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:12.068961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:12.068961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:12.068961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:12.068961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:12.068961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:12.068961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:12.068961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:12.068961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d could not be found. Aug 03 12:18:12.068961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:12.068961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-fbb7d093-a2c3-4ff2-a746-b1690466bd1e tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Returning 404 to user: Snapshot 9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:12.068961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-fbb7d093-a2c3-4ff2-a746-b1690466bd1e tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d" status: 404 len: 111 microversion: 2.1 time: 0.041548 Aug 03 12:18:12.069901 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 403/842] 10.222.0.17 () {58 vars in 1251 bytes} [Wed Aug 3 12:18:12 2022] GET /compute/v2.1/os-snapshots/9db48bc8-a99b-47d6-ad06-0fc0bebcdc5d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:18:12.069997 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3fd1e877-85f3-4b15-af2a-480f26c56b56 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14dc089f70>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:12.171627 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3fd1e877-85f3-4b15-af2a-480f26c56b56 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0" status: 202 len: 0 microversion: 2.1 time: 0.108211 Aug 03 12:18:12.175818 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 440/843] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 3 12:18:12 2022] DELETE /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:18:12.180957 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ca9a6078-2f48-4bd1-a5dc-b8174d25ac6e tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6f6d940>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:12.242080 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ca9a6078-2f48-4bd1-a5dc-b8174d25ac6e tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0" status: 200 len: 345 microversion: 2.1 time: 0.065135 Aug 03 12:18:12.242786 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 404/844] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 3 12:18:12 2022] GET /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:18:13.214414 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1d8213b0-0ee8-4cb1-ad62-7b0b78ea4009 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3476fe18-e798-43b2-92b5-e9da47741625"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:18:13.216857 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1d8213b0-0ee8-4cb1-ad62-7b0b78ea4009 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:13.225044 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1d8213b0-0ee8-4cb1-ad62-7b0b78ea4009 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:13.225496 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1d8213b0-0ee8-4cb1-ad62-7b0b78ea4009 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:13.226298 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1d8213b0-0ee8-4cb1-ad62-7b0b78ea4009 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:13.226761 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1d8213b0-0ee8-4cb1-ad62-7b0b78ea4009 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:13.260374 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a525b57a-136f-4a24-b17f-bcb133f82dd6 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6eafa60>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:13.307440 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-a525b57a-136f-4a24-b17f-bcb133f82dd6 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] HTTP exception thrown: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a525b57a-136f-4a24-b17f-bcb133f82dd6 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Request method failure captured: Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 HTTP/1.1 Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6md9CLUug5AZr6Q3ZhJgy_CBKF5dieCdJyqB8cEpbSL0lNXKjrqKJr4EN4bPs-KYlMoeux0IAy_C22QNckEAZCq-gwGX6v1uFF7CTYCMc4o88BBPtMrpEoEXpxjGzeoOqIMLojmSIjA0FsGfBNd2aVNgRCmaV_s6PfP_B8u3FIpu2v8 Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: b828cda2aeff4145869b56c4f34e57b9 Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1799552980 Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:18:13.309547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:18:13.318831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b828cda2aeff4145869b56c4f34e57b9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b828cda2aeff4145869b56c4f34e57b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b828cda2aeff4145869b56c4f34e57b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b828cda2aeff4145869b56c4f34e57b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:13.318831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1799552980 Aug 03 12:18:13.318831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: b828cda2aeff4145869b56c4f34e57b9 Aug 03 12:18:13.318831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1799552980 Aug 03 12:18:13.318831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-VolumesSnapshotsTestJSON-1799552980-project Aug 03 12:18:13.318831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:18:13.318831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:18:13.318831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: f0130953a68d4d8c9a739d9eb3f666f1 Aug 03 12:18:13.318831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1799552980-project Aug 03 12:18:13.318831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: Aug 03 12:18:13.318831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.318831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0'} Aug 03 12:18:13.318831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. (HTTP 404) (Request-ID: req-71291e0a-bff1-4a69-8c1f-f2eef6ea95d1) Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:13.320907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:18:13.323510 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 12:18:13.325979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a525b57a-136f-4a24-b17f-bcb133f82dd6 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Returning 404 to user: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a525b57a-136f-4a24-b17f-bcb133f82dd6 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0" status: 404 len: 109 microversion: 2.1 time: 0.058632 Aug 03 12:18:13.328449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 405/845] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 3 12:18:13 2022] GET /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 12:18:13.330098 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b0158330-cfea-472c-aaca-ae1c70f03841 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6feb430>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:13.354605 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-b0158330-cfea-472c-aaca-ae1c70f03841 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] HTTP exception thrown: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b0158330-cfea-472c-aaca-ae1c70f03841 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Request method failure captured: Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: DELETE /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 HTTP/1.1 Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6md9CLUug5AZr6Q3ZhJgy_CBKF5dieCdJyqB8cEpbSL0lNXKjrqKJr4EN4bPs-KYlMoeux0IAy_C22QNckEAZCq-gwGX6v1uFF7CTYCMc4o88BBPtMrpEoEXpxjGzeoOqIMLojmSIjA0FsGfBNd2aVNgRCmaV_s6PfP_B8u3FIpu2v8 Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: b828cda2aeff4145869b56c4f34e57b9 Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1799552980 Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:18:13.356585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:18:13.358236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b828cda2aeff4145869b56c4f34e57b9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b828cda2aeff4145869b56c4f34e57b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b828cda2aeff4145869b56c4f34e57b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b828cda2aeff4145869b56c4f34e57b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:13.358236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1799552980 Aug 03 12:18:13.358236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: b828cda2aeff4145869b56c4f34e57b9 Aug 03 12:18:13.358236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1799552980 Aug 03 12:18:13.358236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-VolumesSnapshotsTestJSON-1799552980-project Aug 03 12:18:13.358236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:18:13.358236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:18:13.358236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: f0130953a68d4d8c9a739d9eb3f666f1 Aug 03 12:18:13.358236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1799552980-project Aug 03 12:18:13.358236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: Aug 03 12:18:13.358236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.358236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0'} Aug 03 12:18:13.358236 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. (HTTP 404) (Request-ID: req-0bddc4d3-d8c0-4046-91e9-0aed0295949a) Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:13.359182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 12:18:13.360305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 12:18:13.361471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b0158330-cfea-472c-aaca-ae1c70f03841 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Returning 404 to user: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b0158330-cfea-472c-aaca-ae1c70f03841 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0" status: 404 len: 109 microversion: 2.1 time: 0.038419 Aug 03 12:18:13.362630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 406/846] 10.222.0.17 () {58 vars in 1248 bytes} [Wed Aug 3 12:18:13 2022] DELETE /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:18:13.369010 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0adf7a63-25e5-49b4-ac3e-e4a77fba9006 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Calling method '.version_select at 0x7f14d6f6d280>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:13.401289 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-0adf7a63-25e5-49b4-ac3e-e4a77fba9006 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] HTTP exception thrown: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0adf7a63-25e5-49b4-ac3e-e4a77fba9006 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Request method failure captured: Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 HTTP/1.1 Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6md9CLUug5AZr6Q3ZhJgy_CBKF5dieCdJyqB8cEpbSL0lNXKjrqKJr4EN4bPs-KYlMoeux0IAy_C22QNckEAZCq-gwGX6v1uFF7CTYCMc4o88BBPtMrpEoEXpxjGzeoOqIMLojmSIjA0FsGfBNd2aVNgRCmaV_s6PfP_B8u3FIpu2v8 Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: b828cda2aeff4145869b56c4f34e57b9 Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1799552980 Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:18:13.403334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:18:13.404729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b828cda2aeff4145869b56c4f34e57b9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b828cda2aeff4145869b56c4f34e57b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b828cda2aeff4145869b56c4f34e57b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b828cda2aeff4145869b56c4f34e57b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:13.404729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1799552980 Aug 03 12:18:13.404729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: b828cda2aeff4145869b56c4f34e57b9 Aug 03 12:18:13.404729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1799552980 Aug 03 12:18:13.404729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-VolumesSnapshotsTestJSON-1799552980-project Aug 03 12:18:13.404729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:18:13.404729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:18:13.404729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: f0130953a68d4d8c9a739d9eb3f666f1 Aug 03 12:18:13.404729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1799552980-project Aug 03 12:18:13.404729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: Aug 03 12:18:13.404729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.404729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0'} Aug 03 12:18:13.404729 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. (HTTP 404) (Request-ID: req-ea461925-caff-4660-8036-7caa43589630) Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:13.405501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 12:18:13.407126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 12:18:13.408534 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0adf7a63-25e5-49b4-ac3e-e4a77fba9006 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] Returning 404 to user: Volume e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-0adf7a63-25e5-49b4-ac3e-e4a77fba9006 tempest-VolumesSnapshotsTestJSON-1799552980 tempest-VolumesSnapshotsTestJSON-1799552980-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0" status: 404 len: 109 microversion: 2.1 time: 0.039649 Aug 03 12:18:13.410160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 407/847] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 3 12:18:13 2022] GET /compute/v2.1/os-volumes/e8dd5c5e-f71c-49ef-87ee-b9f0b31c0ac0 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:18:13.531018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1d8213b0-0ee8-4cb1-ad62-7b0b78ea4009 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "POST /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320560 Aug 03 12:18:13.539592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 441/848] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:18:13 2022] POST /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:16.415612 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7751b1df-f3a9-4ece-9ec7-4f9cc04dff44 tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] Calling method '.version_select at 0x7f14d6eaf430>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:16.471230 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7751b1df-f3a9-4ece-9ec7-4f9cc04dff44 tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/dd98f5ac-53e9-48f2-ad6a-51163ba7cb68" status: 200 len: 350 microversion: 2.1 time: 0.063690 Aug 03 12:18:16.471794 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 408/849] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 3 12:18:16 2022] GET /compute/v2.1/os-volumes/dd98f5ac-53e9-48f2-ad6a-51163ba7cb68 => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:17.811194 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cfe19e48-a24a-4461-a825-3657e7d093e5 tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] Calling method '.version_select at 0x7f14d6f6ba60>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:17.866229 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cfe19e48-a24a-4461-a825-3657e7d093e5 tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8cce9f09-e67a-47a0-9a09-22b942d48d44" status: 200 len: 350 microversion: 2.1 time: 0.059744 Aug 03 12:18:17.866851 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 442/850] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 3 12:18:17 2022] GET /compute/v2.1/os-volumes/8cce9f09-e67a-47a0-9a09-22b942d48d44 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:19.216714 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c84ada1f-1966-4bb2-a75d-409ccf5674c5 tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] Calling method '.version_select at 0x7f14d6febe50>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:19.267410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c84ada1f-1966-4bb2-a75d-409ccf5674c5 tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/de7867d3-d0f3-426b-a28c-a48327d24a8d" status: 200 len: 351 microversion: 2.1 time: 0.054949 Aug 03 12:18:19.267980 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 409/851] 10.222.0.17 () {58 vars in 1245 bytes} [Wed Aug 3 12:18:19 2022] GET /compute/v2.1/os-volumes/de7867d3-d0f3-426b-a28c-a48327d24a8d => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:19.281485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8840b491-32ef-44c9-9bfd-004c8caf8e9a tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] Calling method '.version_select at 0x7f14d6e591f0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:19.373582 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8840b491-32ef-44c9-9bfd-004c8caf8e9a tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.096643 Aug 03 12:18:19.374160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 443/852] 10.222.0.17 () {58 vars in 1134 bytes} [Wed Aug 3 12:18:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:18:19.389667 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1f8d2658-8b85-4824-886e-f6c44287c56f tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] Calling method '.version_select at 0x7f14d6f5ddc0>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:19.485806 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1f8d2658-8b85-4824-886e-f6c44287c56f tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.101511 Aug 03 12:18:19.486394 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 410/853] 10.222.0.17 () {58 vars in 1149 bytes} [Wed Aug 3 12:18:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:19.500003 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-61bda108-4bc2-4172-97ee-56e0848b1819 tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] Calling method '.version_select at 0x7f14d6ea48b0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:19.582141 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-61bda108-4bc2-4172-97ee-56e0848b1819 tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085649 Aug 03 12:18:19.583431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 444/854] 10.222.0.17 () {58 vars in 1134 bytes} [Wed Aug 3 12:18:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:18:19.596501 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a7b89d37-2de1-470f-bd67-d09373fc568f tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] Calling method '.version_select at 0x7f14d6f5d8b0>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:19.690394 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a7b89d37-2de1-470f-bd67-d09373fc568f tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.097764 Aug 03 12:18:19.691004 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 411/855] 10.222.0.17 () {58 vars in 1167 bytes} [Wed Aug 3 12:18:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:19.705091 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f09d565c-97e0-45ef-adec-ea0ce816a552 tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] Calling method '.version_select at 0x7f14d6e590d0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:19.792741 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f09d565c-97e0-45ef-adec-ea0ce816a552 tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091424 Aug 03 12:18:19.793306 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 445/856] 10.222.0.17 () {58 vars in 1170 bytes} [Wed Aug 3 12:18:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:18:19.806303 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-25312efb-e1a4-439e-9d15-e44836b330ca tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] Calling method '.version_select at 0x7f14d6feb700>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:19.888571 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-25312efb-e1a4-439e-9d15-e44836b330ca tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085907 Aug 03 12:18:19.889154 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 412/857] 10.222.0.17 () {58 vars in 1155 bytes} [Wed Aug 3 12:18:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:18:19.908401 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c7ee9c2b-ce5d-4854-bd97-2c8cf7c589a6 tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] Calling method '.version_select at 0x7f14d6e4f8b0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:19.993025 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c7ee9c2b-ce5d-4854-bd97-2c8cf7c589a6 tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089077 Aug 03 12:18:19.993603 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 446/858] 10.222.0.17 () {58 vars in 1188 bytes} [Wed Aug 3 12:18:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:20.007907 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-dbf59d3a-9259-4954-80cb-ef30a16d4b9b tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] Calling method '.version_select at 0x7f14d6d36670>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:20.104993 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-dbf59d3a-9259-4954-80cb-ef30a16d4b9b tempest-VolumesTestJSON-255289253 tempest-VolumesTestJSON-255289253-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.101910 Aug 03 12:18:20.105571 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 413/859] 10.222.0.17 () {58 vars in 1155 bytes} [Wed Aug 3 12:18:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:18:21.161812 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9667a46a-968b-4ece-8ba1-08f1895ba4d1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:21.164733 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9667a46a-968b-4ece-8ba1-08f1895ba4d1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:21.171313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9667a46a-968b-4ece-8ba1-08f1895ba4d1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:21.171754 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9667a46a-968b-4ece-8ba1-08f1895ba4d1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:21.172518 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9667a46a-968b-4ece-8ba1-08f1895ba4d1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:21.172948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9667a46a-968b-4ece-8ba1-08f1895ba4d1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:21.177531 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:21.206584 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9667a46a-968b-4ece-8ba1-08f1895ba4d1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049123 Aug 03 12:18:21.207183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 447/860] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:18:21 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:21.353703 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-8b749503-4fea-4f0c-be61-4da799053732 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:21.354203 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-8b749503-4fea-4f0c-be61-4da799053732 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:21.356544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:21.362401 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8b749503-4fea-4f0c-be61-4da799053732 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:21.362883 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8b749503-4fea-4f0c-be61-4da799053732 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:21.364275 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8b749503-4fea-4f0c-be61-4da799053732 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:21.364740 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8b749503-4fea-4f0c-be61-4da799053732 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:21.368398 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:18:21.400817 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-8b749503-4fea-4f0c-be61-4da799053732 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments/ce1b184a-fd42-4887-9f56-3ad288a2589a" status: 200 len: 194 microversion: 2.1 time: 0.051560 Aug 03 12:18:21.401584 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 414/861] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Aug 3 12:18:21 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments/ce1b184a-fd42-4887-9f56-3ad288a2589a => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:21.420749 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d0b91964-b9e7-4634-bb15-f1b84de7f5a1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:21.421631 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d0b91964-b9e7-4634-bb15-f1b84de7f5a1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:21.431872 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0b91964-b9e7-4634-bb15-f1b84de7f5a1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:21.432639 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0b91964-b9e7-4634-bb15-f1b84de7f5a1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:21.433996 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0b91964-b9e7-4634-bb15-f1b84de7f5a1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:21.434848 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d0b91964-b9e7-4634-bb15-f1b84de7f5a1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:21.536538 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-d0b91964-b9e7-4634-bb15-f1b84de7f5a1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lazy-loading 'services' on Instance uuid d938b6ce-6264-40e3-b1c4-9a523771d549 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:18:21.614246 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d0b91964-b9e7-4634-bb15-f1b84de7f5a1 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments/ce1b184a-fd42-4887-9f56-3ad288a2589a" status: 202 len: 0 microversion: 2.1 time: 0.200707 Aug 03 12:18:21.615088 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 448/862] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 3 12:18:21 2022] DELETE /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments/ce1b184a-fd42-4887-9f56-3ad288a2589a => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:18:22.774551 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7138a4f8-a441-42c5-8ad8-40e6199fe6cc tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:22.775194 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7138a4f8-a441-42c5-8ad8-40e6199fe6cc tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:22.781801 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7138a4f8-a441-42c5-8ad8-40e6199fe6cc tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:22.782260 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7138a4f8-a441-42c5-8ad8-40e6199fe6cc tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:22.783083 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7138a4f8-a441-42c5-8ad8-40e6199fe6cc tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:22.783523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7138a4f8-a441-42c5-8ad8-40e6199fe6cc tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:22.815791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7138a4f8-a441-42c5-8ad8-40e6199fe6cc tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments/3476fe18-e798-43b2-92b5-e9da47741625" status: 200 len: 194 microversion: 2.1 time: 0.045719 Aug 03 12:18:22.816403 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 415/863] 10.222.0.17 () {58 vars in 1413 bytes} [Wed Aug 3 12:18:22 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments/3476fe18-e798-43b2-92b5-e9da47741625 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:18:22.828046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-74b62ea5-b692-42ba-9103-12bf1cdffd18 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:22.828624 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-74b62ea5-b692-42ba-9103-12bf1cdffd18 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:22.835154 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-74b62ea5-b692-42ba-9103-12bf1cdffd18 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:22.835603 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-74b62ea5-b692-42ba-9103-12bf1cdffd18 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:22.836373 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-74b62ea5-b692-42ba-9103-12bf1cdffd18 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:22.836928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-74b62ea5-b692-42ba-9103-12bf1cdffd18 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:22.922409 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-74b62ea5-b692-42ba-9103-12bf1cdffd18 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lazy-loading 'services' on Instance uuid d938b6ce-6264-40e3-b1c4-9a523771d549 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:18:22.997639 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-74b62ea5-b692-42ba-9103-12bf1cdffd18 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments/3476fe18-e798-43b2-92b5-e9da47741625" status: 202 len: 0 microversion: 2.1 time: 0.174141 Aug 03 12:18:22.998351 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 449/864] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 3 12:18:22 2022] DELETE /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments/3476fe18-e798-43b2-92b5-e9da47741625 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:18:24.198433 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-bf00b9ae-22f8-4f8d-acad-1e86169aa1e7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:24.200675 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-bf00b9ae-22f8-4f8d-acad-1e86169aa1e7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:24.208119 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bf00b9ae-22f8-4f8d-acad-1e86169aa1e7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:24.208638 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bf00b9ae-22f8-4f8d-acad-1e86169aa1e7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:24.209467 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bf00b9ae-22f8-4f8d-acad-1e86169aa1e7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:24.209917 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bf00b9ae-22f8-4f8d-acad-1e86169aa1e7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:24.253417 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-bf00b9ae-22f8-4f8d-acad-1e86169aa1e7 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059888 Aug 03 12:18:24.253417 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 416/865] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:18:24 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 12:18:24.379395 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c38178d1-512e-4b82-a068-aa47312566e9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:24.381919 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c38178d1-512e-4b82-a068-aa47312566e9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:24.391688 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c38178d1-512e-4b82-a068-aa47312566e9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:24.392157 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c38178d1-512e-4b82-a068-aa47312566e9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:24.392961 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c38178d1-512e-4b82-a068-aa47312566e9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:24.393401 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c38178d1-512e-4b82-a068-aa47312566e9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:24.427124 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c38178d1-512e-4b82-a068-aa47312566e9 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051602 Aug 03 12:18:24.428004 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 450/866] 10.222.0.17 () {58 vars in 1302 bytes} [Wed Aug 3 12:18:24 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 12:18:24.496508 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-9d06b933-ba53-49f5-98ed-9df57dfc63e3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:24.497009 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-9d06b933-ba53-49f5-98ed-9df57dfc63e3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:24.503184 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9d06b933-ba53-49f5-98ed-9df57dfc63e3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:24.503646 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9d06b933-ba53-49f5-98ed-9df57dfc63e3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:24.504543 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9d06b933-ba53-49f5-98ed-9df57dfc63e3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:24.505296 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9d06b933-ba53-49f5-98ed-9df57dfc63e3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:24.533596 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-9d06b933-ba53-49f5-98ed-9df57dfc63e3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Going to try to terminate instance {{(pid=117911) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:18:24.617047 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-9d06b933-ba53-49f5-98ed-9df57dfc63e3 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 204 len: 0 microversion: 2.1 time: 0.124050 Aug 03 12:18:24.617667 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 417/867] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:18:24 2022] DELETE /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:18:24.625749 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-349a84c4-55c7-4c79-a39c-f2eed15a2987 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:24.626382 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-349a84c4-55c7-4c79-a39c-f2eed15a2987 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:24.632519 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-349a84c4-55c7-4c79-a39c-f2eed15a2987 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:24.632970 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-349a84c4-55c7-4c79-a39c-f2eed15a2987 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:24.633739 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-349a84c4-55c7-4c79-a39c-f2eed15a2987 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:24.634180 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-349a84c4-55c7-4c79-a39c-f2eed15a2987 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:24.768297 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-349a84c4-55c7-4c79-a39c-f2eed15a2987 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:18:24.777100 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-349a84c4-55c7-4c79-a39c-f2eed15a2987 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1675 microversion: 2.1 time: 0.155087 Aug 03 12:18:24.777989 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 451/868] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:18:24 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:18:25.800126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-93753a0a-9721-4463-99c0-e1b98e8e7a59 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:25.801731 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-93753a0a-9721-4463-99c0-e1b98e8e7a59 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:25.809944 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-93753a0a-9721-4463-99c0-e1b98e8e7a59 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:25.810410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-93753a0a-9721-4463-99c0-e1b98e8e7a59 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:25.811222 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-93753a0a-9721-4463-99c0-e1b98e8e7a59 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:25.811660 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-93753a0a-9721-4463-99c0-e1b98e8e7a59 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:25.968014 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-93753a0a-9721-4463-99c0-e1b98e8e7a59 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:18:25.976750 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-93753a0a-9721-4463-99c0-e1b98e8e7a59 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1675 microversion: 2.1 time: 0.181239 Aug 03 12:18:25.977326 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 418/869] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:18:25 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:18:26.999379 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-993215a3-610f-4ee9-aa4d-6a54dadfb6ce tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:27.000007 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-993215a3-610f-4ee9-aa4d-6a54dadfb6ce tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:27.008195 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-993215a3-610f-4ee9-aa4d-6a54dadfb6ce tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:27.008925 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-993215a3-610f-4ee9-aa4d-6a54dadfb6ce tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:27.009720 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-993215a3-610f-4ee9-aa4d-6a54dadfb6ce tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:27.010335 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-993215a3-610f-4ee9-aa4d-6a54dadfb6ce tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:27.122577 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-993215a3-610f-4ee9-aa4d-6a54dadfb6ce tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023c699e0cac426f8e7229ebbb7727b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf1655c29144bb2a7d925a5a5b22bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:18:27.132133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-993215a3-610f-4ee9-aa4d-6a54dadfb6ce tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 200 len: 1607 microversion: 2.1 time: 0.137191 Aug 03 12:18:27.134852 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 452/870] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:18:26 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 1607 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:18:27.346481 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-3df187f3-6694-465e-86ba-0988b9fe8a1c req-c504e39e-74b7-4521-bc87-619e9ca63afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d938b6ce-6264-40e3-b1c4-9a523771d549", "name": "network-vif-deleted", "tag": "f9c1d2b4-2864-4567-af44-1e67a587e118"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:18:27.357780 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-3df187f3-6694-465e-86ba-0988b9fe8a1c req-c504e39e-74b7-4521-bc87-619e9ca63afc service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:27.358557 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-3df187f3-6694-465e-86ba-0988b9fe8a1c req-c504e39e-74b7-4521-bc87-619e9ca63afc service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:27.372789 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-3df187f3-6694-465e-86ba-0988b9fe8a1c req-c504e39e-74b7-4521-bc87-619e9ca63afc service nova] Creating event network-vif-deleted:f9c1d2b4-2864-4567-af44-1e67a587e118 for instance d938b6ce-6264-40e3-b1c4-9a523771d549 on hv-cinder-83602 Aug 03 12:18:27.379644 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-3df187f3-6694-465e-86ba-0988b9fe8a1c req-c504e39e-74b7-4521-bc87-619e9ca63afc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036125 Aug 03 12:18:27.390166 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 419/871] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:18:28.160015 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ae62281c-b0fa-406c-bd08-a8f98b8f6d9d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:28.160869 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ae62281c-b0fa-406c-bd08-a8f98b8f6d9d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:28.172723 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ae62281c-b0fa-406c-bd08-a8f98b8f6d9d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:28.174819 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ae62281c-b0fa-406c-bd08-a8f98b8f6d9d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:28.176359 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ae62281c-b0fa-406c-bd08-a8f98b8f6d9d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:28.177046 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ae62281c-b0fa-406c-bd08-a8f98b8f6d9d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:28.193444 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-ae62281c-b0fa-406c-bd08-a8f98b8f6d9d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] HTTP exception thrown: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ae62281c-b0fa-406c-bd08-a8f98b8f6d9d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Request method failure captured: Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 HTTP/1.1 Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mZEJTKvPklrABZ86b2SLk-cx3F8bCfPt3_GFZlVL42AGO1mX3IbPa3KVw_Eie_jMpgAuscZhZ7MJ519e3rKjKe8j1ROLyT-jk0JA4Xjf4627c8epFqHsm4LouvB5LVnNb5_kec_0vgWUhLbLiFNzWTWfikwpsNRFifyz_VAJ0oHZLQ Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 8bf1655c29144bb2a7d925a5a5b22bdb Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:18:28.195185 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:18:28.198036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8bf1655c29144bb2a7d925a5a5b22bdb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:28.198036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:28.198036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 8bf1655c29144bb2a7d925a5a5b22bdb Aug 03 12:18:28.198036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:28.198036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeTestJSON-1103562566-project Aug 03 12:18:28.198036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:18:28.198036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:18:28.198036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 023c699e0cac426f8e7229ebbb7727b7 Aug 03 12:18:28.198036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeTestJSON-1103562566-project Aug 03 12:18:28.198036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:18:28.198036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:28.198036 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'd938b6ce-6264-40e3-b1c4-9a523771d549'} Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:28.200794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:28.203514 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:28.206074 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ae62281c-b0fa-406c-bd08-a8f98b8f6d9d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Returning 404 to user: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:28.206074 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ae62281c-b0fa-406c-bd08-a8f98b8f6d9d tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 404 len: 111 microversion: 2.1 time: 0.044927 Aug 03 12:18:28.206074 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 453/872] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:18:28 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:18:28.208123 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0ba3963c-2cea-48ea-a0a3-cf2c39014968 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '.version_select at 0x7f14d6f5d280>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:28.231461 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-0ba3963c-2cea-48ea-a0a3-cf2c39014968 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1605398985" status: 202 len: 0 microversion: 2.1 time: 0.028527 Aug 03 12:18:28.234961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 420/873] 10.222.0.17 () {58 vars in 1221 bytes} [Wed Aug 3 12:18:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1605398985 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:18:28.819702 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2df2a1f2-f53e-42dd-8482-f19361706842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:28.822301 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2df2a1f2-f53e-42dd-8482-f19361706842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:28.829133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2df2a1f2-f53e-42dd-8482-f19361706842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:28.829661 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2df2a1f2-f53e-42dd-8482-f19361706842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:28.830551 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2df2a1f2-f53e-42dd-8482-f19361706842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:28.830991 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2df2a1f2-f53e-42dd-8482-f19361706842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:28.866679 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2df2a1f2-f53e-42dd-8482-f19361706842 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052718 Aug 03 12:18:28.868257 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 454/874] 10.222.0.17 () {60 vars in 1343 bytes} [Wed Aug 3 12:18:28 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:18:28.952970 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-920cfb7e-147d-4783-bb2d-42f9ee5450fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:28.954629 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-920cfb7e-147d-4783-bb2d-42f9ee5450fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:28.963866 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-920cfb7e-147d-4783-bb2d-42f9ee5450fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:28.964278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-920cfb7e-147d-4783-bb2d-42f9ee5450fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:28.965314 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-920cfb7e-147d-4783-bb2d-42f9ee5450fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:28.965766 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-920cfb7e-147d-4783-bb2d-42f9ee5450fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:29.009828 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-920cfb7e-147d-4783-bb2d-42f9ee5450fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Going to try to terminate instance {{(pid=117911) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:18:29.161581 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-920cfb7e-147d-4783-bb2d-42f9ee5450fe tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 204 len: 0 microversion: 2.20 time: 0.212026 Aug 03 12:18:29.162546 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 421/875] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Aug 3 12:18:28 2022] DELETE /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 12:18:29.174342 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bc604729-96bb-4da1-83b3-270cf199e745 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:29.176058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bc604729-96bb-4da1-83b3-270cf199e745 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:29.184388 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bc604729-96bb-4da1-83b3-270cf199e745 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:29.184750 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bc604729-96bb-4da1-83b3-270cf199e745 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:29.185735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bc604729-96bb-4da1-83b3-270cf199e745 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:29.186344 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bc604729-96bb-4da1-83b3-270cf199e745 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:29.413455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bc604729-96bb-4da1-83b3-270cf199e745 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:18:29.435047 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bc604729-96bb-4da1-83b3-270cf199e745 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:18:29.437874 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bc604729-96bb-4da1-83b3-270cf199e745 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:18:29.440490 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bc604729-96bb-4da1-83b3-270cf199e745 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.271042 Aug 03 12:18:29.442297 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 455/876] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:18:29 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:18:30.467900 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-60f5376d-7495-4647-a694-b7438b2ba0be tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:30.469299 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-60f5376d-7495-4647-a694-b7438b2ba0be tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:30.486282 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-60f5376d-7495-4647-a694-b7438b2ba0be tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:30.487021 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-60f5376d-7495-4647-a694-b7438b2ba0be tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:30.488978 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-60f5376d-7495-4647-a694-b7438b2ba0be tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:30.492559 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-60f5376d-7495-4647-a694-b7438b2ba0be tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:30.807108 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-60f5376d-7495-4647-a694-b7438b2ba0be tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:18:30.823809 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-60f5376d-7495-4647-a694-b7438b2ba0be tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:18:30.825651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-60f5376d-7495-4647-a694-b7438b2ba0be tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:18:30.827516 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-60f5376d-7495-4647-a694-b7438b2ba0be tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1723 microversion: 2.20 time: 0.364185 Aug 03 12:18:30.828948 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 422/877] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:18:30 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 12:18:31.623392 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-0bc7ecf1-c620-4ce0-91d2-198b8137d2a2 req-15048ca1-8240-4699-bc65-cb154a898745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5335f69-42aa-4fcf-8ee9-223f8e1485ec", "name": "network-vif-deleted", "tag": "02cf3d48-0345-435e-ba69-48f06b2d3b86"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:18:31.638002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-0bc7ecf1-c620-4ce0-91d2-198b8137d2a2 req-15048ca1-8240-4699-bc65-cb154a898745 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:31.638592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-0bc7ecf1-c620-4ce0-91d2-198b8137d2a2 req-15048ca1-8240-4699-bc65-cb154a898745 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:31.664164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-0bc7ecf1-c620-4ce0-91d2-198b8137d2a2 req-15048ca1-8240-4699-bc65-cb154a898745 service nova] Creating event network-vif-deleted:02cf3d48-0345-435e-ba69-48f06b2d3b86 for instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec on hv-cinder-83602 Aug 03 12:18:31.672067 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-0bc7ecf1-c620-4ce0-91d2-198b8137d2a2 req-15048ca1-8240-4699-bc65-cb154a898745 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052237 Aug 03 12:18:31.673349 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 456/878] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:18:31.809730 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f222a90d-14b3-43c0-bc24-396cc598a2af tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:31.810307 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f222a90d-14b3-43c0-bc24-396cc598a2af tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:31.818256 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f222a90d-14b3-43c0-bc24-396cc598a2af tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:31.818731 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f222a90d-14b3-43c0-bc24-396cc598a2af tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:31.819502 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f222a90d-14b3-43c0-bc24-396cc598a2af tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:31.819936 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f222a90d-14b3-43c0-bc24-396cc598a2af tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:31.835281 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-f222a90d-14b3-43c0-bc24-396cc598a2af tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] HTTP exception thrown: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f222a90d-14b3-43c0-bc24-396cc598a2af tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Request method failure captured: Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: DELETE /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 HTTP/1.1 Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mZEJTKvPklrABZ86b2SLk-cx3F8bCfPt3_GFZlVL42AGO1mX3IbPa3KVw_Eie_jMpgAuscZhZ7MJ519e3rKjKe8j1ROLyT-jk0JA4Xjf4627c8epFqHsm4LouvB5LVnNb5_kec_0vgWUhLbLiFNzWTWfikwpsNRFifyz_VAJ0oHZLQ Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 8bf1655c29144bb2a7d925a5a5b22bdb Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:18:31.837278 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:18:31.842410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8bf1655c29144bb2a7d925a5a5b22bdb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:31.842410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:31.842410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 8bf1655c29144bb2a7d925a5a5b22bdb Aug 03 12:18:31.842410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:31.842410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-AttachVolumeTestJSON-1103562566-project Aug 03 12:18:31.842410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:18:31.842410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:18:31.842410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 023c699e0cac426f8e7229ebbb7727b7 Aug 03 12:18:31.842410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-AttachVolumeTestJSON-1103562566-project Aug 03 12:18:31.842410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:18:31.842410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:31.842410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'd938b6ce-6264-40e3-b1c4-9a523771d549'} Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:31.843264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:31.844739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:31.846198 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f222a90d-14b3-43c0-bc24-396cc598a2af tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Returning 404 to user: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:31.846198 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f222a90d-14b3-43c0-bc24-396cc598a2af tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 404 len: 111 microversion: 2.1 time: 0.033671 Aug 03 12:18:31.846198 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 423/879] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:18:31 2022] DELETE /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:18:31.853946 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3bd5e2c9-89e1-4c59-a3d8-288d1c41e71c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:31.854691 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3bd5e2c9-89e1-4c59-a3d8-288d1c41e71c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: d938b6ce-6264-40e3-b1c4-9a523771d549] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:31.867816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3bd5e2c9-89e1-4c59-a3d8-288d1c41e71c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:31.868543 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3bd5e2c9-89e1-4c59-a3d8-288d1c41e71c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:31.869988 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3bd5e2c9-89e1-4c59-a3d8-288d1c41e71c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:31.870772 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3bd5e2c9-89e1-4c59-a3d8-288d1c41e71c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:31.875339 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-cebb1eb2-ae35-4eab-b1ce-119747eb4908 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:31.876240 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-cebb1eb2-ae35-4eab-b1ce-119747eb4908 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:31.883478 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cebb1eb2-ae35-4eab-b1ce-119747eb4908 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:31.884071 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cebb1eb2-ae35-4eab-b1ce-119747eb4908 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:31.885288 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cebb1eb2-ae35-4eab-b1ce-119747eb4908 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:31.886029 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cebb1eb2-ae35-4eab-b1ce-119747eb4908 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:31.887092 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-3bd5e2c9-89e1-4c59-a3d8-288d1c41e71c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] HTTP exception thrown: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3bd5e2c9-89e1-4c59-a3d8-288d1c41e71c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Request method failure captured: Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 HTTP/1.1 Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mZEJTKvPklrABZ86b2SLk-cx3F8bCfPt3_GFZlVL42AGO1mX3IbPa3KVw_Eie_jMpgAuscZhZ7MJ519e3rKjKe8j1ROLyT-jk0JA4Xjf4627c8epFqHsm4LouvB5LVnNb5_kec_0vgWUhLbLiFNzWTWfikwpsNRFifyz_VAJ0oHZLQ Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 8bf1655c29144bb2a7d925a5a5b22bdb Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:18:31.888781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:18:31.890179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8bf1655c29144bb2a7d925a5a5b22bdb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:31.890179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:31.890179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 8bf1655c29144bb2a7d925a5a5b22bdb Aug 03 12:18:31.890179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:31.890179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeTestJSON-1103562566-project Aug 03 12:18:31.890179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:18:31.890179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:18:31.890179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 023c699e0cac426f8e7229ebbb7727b7 Aug 03 12:18:31.890179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeTestJSON-1103562566-project Aug 03 12:18:31.890179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:18:31.890179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:31.890179 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'd938b6ce-6264-40e3-b1c4-9a523771d549'} Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:31.891183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. Aug 03 12:18:31.893526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:31.895556 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3bd5e2c9-89e1-4c59-a3d8-288d1c41e71c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Returning 404 to user: Instance d938b6ce-6264-40e3-b1c4-9a523771d549 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:31.895556 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3bd5e2c9-89e1-4c59-a3d8-288d1c41e71c tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549" status: 404 len: 111 microversion: 2.1 time: 0.042625 Aug 03 12:18:31.896376 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 457/880] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:18:31 2022] GET /compute/v2.1/servers/d938b6ce-6264-40e3-b1c4-9a523771d549 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:18:31.931066 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cebb1eb2-ae35-4eab-b1ce-119747eb4908 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:31.931699 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-cebb1eb2-ae35-4eab-b1ce-119747eb4908 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:31.932371 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-cebb1eb2-ae35-4eab-b1ce-119747eb4908 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lazy-loading 'fault' on Instance uuid f5335f69-42aa-4fcf-8ee9-223f8e1485ec {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:18:31.996681 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cebb1eb2-ae35-4eab-b1ce-119747eb4908 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:18:32.008282 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cebb1eb2-ae35-4eab-b1ce-119747eb4908 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:18:32.010196 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-cebb1eb2-ae35-4eab-b1ce-119747eb4908 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '42ce2627c0f142f8892c182f69ef9a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbed7fab4584f379dbefe4af9826544', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:18:32.012132 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-cebb1eb2-ae35-4eab-b1ce-119747eb4908 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 200 len: 1371 microversion: 2.20 time: 0.141362 Aug 03 12:18:32.012962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 424/881] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:18:31 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 1371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 12:18:33.037160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b24eacff-cee4-47a1-a501-fbacdab0f7f0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:33.037777 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b24eacff-cee4-47a1-a501-fbacdab0f7f0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:33.044466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b24eacff-cee4-47a1-a501-fbacdab0f7f0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:33.044918 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b24eacff-cee4-47a1-a501-fbacdab0f7f0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:33.045693 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b24eacff-cee4-47a1-a501-fbacdab0f7f0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:33.046170 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b24eacff-cee4-47a1-a501-fbacdab0f7f0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:33.060984 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-b24eacff-cee4-47a1-a501-fbacdab0f7f0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] HTTP exception thrown: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b24eacff-cee4-47a1-a501-fbacdab0f7f0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Request method failure captured: Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec HTTP/1.1 Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXh0wloqivlKTpkBNiD0FOFLHIZyXKcsZJzySbmGUQ8hR0gGh-XabyEUGCVut0Zb-W6k661_ZfaqEplP8kTCnHA_8nHG5jPZLbAMEc3OTpbfsxSl2i4g-BhfL6yvp4_v5urKFqVSmi8FAxxna_hrjVzNov-Ncvie3wjoHzkqKGZorA Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: fbbed7fab4584f379dbefe4af9826544 Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:18:33.062569 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:18:33.064730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fbbed7fab4584f379dbefe4af9826544", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:33.064730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:33.064730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: fbbed7fab4584f379dbefe4af9826544 Aug 03 12:18:33.064730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:33.064730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeShelveTestJSON-1781968059-project Aug 03 12:18:33.064730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:18:33.064730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:18:33.064730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 42ce2627c0f142f8892c182f69ef9a39 Aug 03 12:18:33.064730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781968059-project Aug 03 12:18:33.064730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:18:33.064730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:33.064730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'f5335f69-42aa-4fcf-8ee9-223f8e1485ec'} Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:33.066066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:33.068571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.070390 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b24eacff-cee4-47a1-a501-fbacdab0f7f0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Returning 404 to user: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:33.070390 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b24eacff-cee4-47a1-a501-fbacdab0f7f0 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 404 len: 111 microversion: 2.20 time: 0.030797 Aug 03 12:18:33.070390 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 458/882] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:18:33 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 12:18:33.078866 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ca7994a3-db18-41a2-bfd9-c3d03879ffd6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '.version_select at 0x7f14d6dd09d0>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:33.079964 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-663995cd-8619-4ac3-a03e-a81202a1fe93 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:33.080466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-663995cd-8619-4ac3-a03e-a81202a1fe93 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:33.086784 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-663995cd-8619-4ac3-a03e-a81202a1fe93 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:33.087226 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-663995cd-8619-4ac3-a03e-a81202a1fe93 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:33.087994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-663995cd-8619-4ac3-a03e-a81202a1fe93 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:33.088417 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-663995cd-8619-4ac3-a03e-a81202a1fe93 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:33.103439 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-663995cd-8619-4ac3-a03e-a81202a1fe93 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] HTTP exception thrown: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-663995cd-8619-4ac3-a03e-a81202a1fe93 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Request method failure captured: Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: DELETE /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 HTTP/1.1 Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mZEJTKvPklrABZ86b2SLk-cx3F8bCfPt3_GFZlVL42AGO1mX3IbPa3KVw_Eie_jMpgAuscZhZ7MJ519e3rKjKe8j1ROLyT-jk0JA4Xjf4627c8epFqHsm4LouvB5LVnNb5_kec_0vgWUhLbLiFNzWTWfikwpsNRFifyz_VAJ0oHZLQ Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 8bf1655c29144bb2a7d925a5a5b22bdb Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:18:33.105002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:18:33.106865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8bf1655c29144bb2a7d925a5a5b22bdb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:33.106865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:33.106865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 8bf1655c29144bb2a7d925a5a5b22bdb Aug 03 12:18:33.106865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:33.106865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeTestJSON-1103562566-project Aug 03 12:18:33.106865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:18:33.106865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:18:33.106865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 023c699e0cac426f8e7229ebbb7727b7 Aug 03 12:18:33.106865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeTestJSON-1103562566-project Aug 03 12:18:33.106865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:18:33.106865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:18:33.106865 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'ed09302a-b62b-4353-976f-e47444e0dda4'} Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:33.107726 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:18:33.110566 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.114174 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-663995cd-8619-4ac3-a03e-a81202a1fe93 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Returning 404 to user: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:33.114855 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ca7994a3-db18-41a2-bfd9-c3d03879ffd6 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-956143823" status: 204 len: 0 microversion: 2.20 time: 0.035535 Aug 03 12:18:33.115002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-663995cd-8619-4ac3-a03e-a81202a1fe93 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 404 len: 111 microversion: 2.1 time: 0.030266 Aug 03 12:18:33.115002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 459/883] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:18:33 2022] DELETE /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 12:18:33.115280 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 425/884] 10.222.0.17 () {60 vars in 1259 bytes} [Wed Aug 3 12:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-956143823 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 12:18:33.115776 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5b43cf78-d0fa-4444-863a-ca0527f32e31 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:33.116472 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5b43cf78-d0fa-4444-863a-ca0527f32e31 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] [instance: ed09302a-b62b-4353-976f-e47444e0dda4] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:33.123433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b43cf78-d0fa-4444-863a-ca0527f32e31 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:33.123880 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b43cf78-d0fa-4444-863a-ca0527f32e31 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:33.124658 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b43cf78-d0fa-4444-863a-ca0527f32e31 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:33.125089 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b43cf78-d0fa-4444-863a-ca0527f32e31 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:33.142644 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-5b43cf78-d0fa-4444-863a-ca0527f32e31 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] HTTP exception thrown: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5b43cf78-d0fa-4444-863a-ca0527f32e31 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Request method failure captured: Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 HTTP/1.1 Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mZEJTKvPklrABZ86b2SLk-cx3F8bCfPt3_GFZlVL42AGO1mX3IbPa3KVw_Eie_jMpgAuscZhZ7MJ519e3rKjKe8j1ROLyT-jk0JA4Xjf4627c8epFqHsm4LouvB5LVnNb5_kec_0vgWUhLbLiFNzWTWfikwpsNRFifyz_VAJ0oHZLQ Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 8bf1655c29144bb2a7d925a5a5b22bdb Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:18:33.144191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:18:33.152361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8bf1655c29144bb2a7d925a5a5b22bdb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8bf1655c29144bb2a7d925a5a5b22bdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:33.152361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:33.152361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 8bf1655c29144bb2a7d925a5a5b22bdb Aug 03 12:18:33.152361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1103562566 Aug 03 12:18:33.152361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeTestJSON-1103562566-project Aug 03 12:18:33.152361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:18:33.152361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:18:33.152361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 023c699e0cac426f8e7229ebbb7727b7 Aug 03 12:18:33.152361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeTestJSON-1103562566-project Aug 03 12:18:33.152361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:18:33.152361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:18:33.152361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'ed09302a-b62b-4353-976f-e47444e0dda4'} Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:33.153717 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. Aug 03 12:18:33.155313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:33.157022 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5b43cf78-d0fa-4444-863a-ca0527f32e31 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] Returning 404 to user: Instance ed09302a-b62b-4353-976f-e47444e0dda4 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:33.157022 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5b43cf78-d0fa-4444-863a-ca0527f32e31 tempest-AttachVolumeTestJSON-1103562566 tempest-AttachVolumeTestJSON-1103562566-project] 10.222.0.17 "GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4" status: 404 len: 111 microversion: 2.1 time: 0.034795 Aug 03 12:18:33.157022 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 460/885] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:18:33 2022] GET /compute/v2.1/servers/ed09302a-b62b-4353-976f-e47444e0dda4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:18:35.151771 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4643216a-578f-4b0a-a2ac-e682b83a2218 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:35.152872 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-4643216a-578f-4b0a-a2ac-e682b83a2218 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:35.165613 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4643216a-578f-4b0a-a2ac-e682b83a2218 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:35.168314 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4643216a-578f-4b0a-a2ac-e682b83a2218 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:35.172431 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4643216a-578f-4b0a-a2ac-e682b83a2218 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:35.172985 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4643216a-578f-4b0a-a2ac-e682b83a2218 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:35.202742 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-4643216a-578f-4b0a-a2ac-e682b83a2218 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] HTTP exception thrown: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4643216a-578f-4b0a-a2ac-e682b83a2218 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Request method failure captured: Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: DELETE /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec HTTP/1.1 Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXh0wloqivlKTpkBNiD0FOFLHIZyXKcsZJzySbmGUQ8hR0gGh-XabyEUGCVut0Zb-W6k661_ZfaqEplP8kTCnHA_8nHG5jPZLbAMEc3OTpbfsxSl2i4g-BhfL6yvp4_v5urKFqVSmi8FAxxna_hrjVzNov-Ncvie3wjoHzkqKGZorA Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: fbbed7fab4584f379dbefe4af9826544 Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:18:35.204910 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:18:35.206250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fbbed7fab4584f379dbefe4af9826544", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:35.206250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:35.206250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: fbbed7fab4584f379dbefe4af9826544 Aug 03 12:18:35.206250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:35.206250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-AttachVolumeShelveTestJSON-1781968059-project Aug 03 12:18:35.206250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:18:35.206250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:18:35.206250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 42ce2627c0f142f8892c182f69ef9a39 Aug 03 12:18:35.206250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781968059-project Aug 03 12:18:35.206250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:18:35.206250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:35.206250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'f5335f69-42aa-4fcf-8ee9-223f8e1485ec'} Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:35.207664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:35.208908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:35.211603 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4643216a-578f-4b0a-a2ac-e682b83a2218 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Returning 404 to user: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:35.212676 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-4643216a-578f-4b0a-a2ac-e682b83a2218 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 404 len: 111 microversion: 2.20 time: 0.066019 Aug 03 12:18:35.214613 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 426/886] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Aug 3 12:18:35 2022] DELETE /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 12:18:35.222510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-80a4d12b-e173-465f-ae84-0d758a3987ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:35.224349 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-80a4d12b-e173-465f-ae84-0d758a3987ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: f5335f69-42aa-4fcf-8ee9-223f8e1485ec] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:35.231674 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80a4d12b-e173-465f-ae84-0d758a3987ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:35.232146 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80a4d12b-e173-465f-ae84-0d758a3987ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:35.232947 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80a4d12b-e173-465f-ae84-0d758a3987ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:35.233572 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-80a4d12b-e173-465f-ae84-0d758a3987ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:35.249553 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-80a4d12b-e173-465f-ae84-0d758a3987ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] HTTP exception thrown: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-80a4d12b-e173-465f-ae84-0d758a3987ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Request method failure captured: Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec HTTP/1.1 Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXh0wloqivlKTpkBNiD0FOFLHIZyXKcsZJzySbmGUQ8hR0gGh-XabyEUGCVut0Zb-W6k661_ZfaqEplP8kTCnHA_8nHG5jPZLbAMEc3OTpbfsxSl2i4g-BhfL6yvp4_v5urKFqVSmi8FAxxna_hrjVzNov-Ncvie3wjoHzkqKGZorA Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: fbbed7fab4584f379dbefe4af9826544 Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:18:35.251160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:18:35.252875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fbbed7fab4584f379dbefe4af9826544", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:35.252875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:35.252875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: fbbed7fab4584f379dbefe4af9826544 Aug 03 12:18:35.252875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:35.252875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeShelveTestJSON-1781968059-project Aug 03 12:18:35.252875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:18:35.252875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:18:35.252875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 42ce2627c0f142f8892c182f69ef9a39 Aug 03 12:18:35.252875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781968059-project Aug 03 12:18:35.252875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:18:35.252875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:35.252875 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'f5335f69-42aa-4fcf-8ee9-223f8e1485ec'} Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:35.253622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. Aug 03 12:18:35.255431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:35.257131 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-80a4d12b-e173-465f-ae84-0d758a3987ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Returning 404 to user: Instance f5335f69-42aa-4fcf-8ee9-223f8e1485ec could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:35.257131 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-80a4d12b-e173-465f-ae84-0d758a3987ec tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec" status: 404 len: 111 microversion: 2.20 time: 0.033983 Aug 03 12:18:35.257131 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 461/887] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:18:35 2022] GET /compute/v2.1/servers/f5335f69-42aa-4fcf-8ee9-223f8e1485ec => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 12:18:36.440210 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f00881e4-8447-4393-a0b2-fb901e855c13 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:36.440780 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f00881e4-8447-4393-a0b2-fb901e855c13 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:36.449035 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f00881e4-8447-4393-a0b2-fb901e855c13 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:36.449579 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f00881e4-8447-4393-a0b2-fb901e855c13 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:36.450799 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f00881e4-8447-4393-a0b2-fb901e855c13 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:36.451352 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f00881e4-8447-4393-a0b2-fb901e855c13 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:36.473002 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-f00881e4-8447-4393-a0b2-fb901e855c13 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] HTTP exception thrown: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f00881e4-8447-4393-a0b2-fb901e855c13 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Request method failure captured: Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: DELETE /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 HTTP/1.1 Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mXh0wloqivlKTpkBNiD0FOFLHIZyXKcsZJzySbmGUQ8hR0gGh-XabyEUGCVut0Zb-W6k661_ZfaqEplP8kTCnHA_8nHG5jPZLbAMEc3OTpbfsxSl2i4g-BhfL6yvp4_v5urKFqVSmi8FAxxna_hrjVzNov-Ncvie3wjoHzkqKGZorA Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: fbbed7fab4584f379dbefe4af9826544 Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:18:36.475796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:18:36.477182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fbbed7fab4584f379dbefe4af9826544", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:36.477182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:36.477182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: fbbed7fab4584f379dbefe4af9826544 Aug 03 12:18:36.477182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:36.477182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-AttachVolumeShelveTestJSON-1781968059-project Aug 03 12:18:36.477182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:18:36.477182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:18:36.477182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 42ce2627c0f142f8892c182f69ef9a39 Aug 03 12:18:36.477182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781968059-project Aug 03 12:18:36.477182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:18:36.477182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:18:36.477182 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': '4afb38cd-ec9c-4509-b7c8-91b170684ec5'} Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:36.477914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:18:36.479287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:18:36.482506 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f00881e4-8447-4393-a0b2-fb901e855c13 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Returning 404 to user: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:36.483628 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f00881e4-8447-4393-a0b2-fb901e855c13 tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 404 len: 111 microversion: 2.20 time: 0.048896 Aug 03 12:18:36.488292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 427/888] 10.222.0.17 () {60 vars in 1280 bytes} [Wed Aug 3 12:18:36 2022] DELETE /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 12:18:36.494364 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0655a24b-31a7-43f6-97ad-909e7569a97b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:18:36.495291 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0655a24b-31a7-43f6-97ad-909e7569a97b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] [instance: 4afb38cd-ec9c-4509-b7c8-91b170684ec5] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:18:36.503151 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0655a24b-31a7-43f6-97ad-909e7569a97b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:36.504335 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0655a24b-31a7-43f6-97ad-909e7569a97b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:36.505364 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0655a24b-31a7-43f6-97ad-909e7569a97b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:18:36.505811 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0655a24b-31a7-43f6-97ad-909e7569a97b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:18:36.540536 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-0655a24b-31a7-43f6-97ad-909e7569a97b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] HTTP exception thrown: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0655a24b-31a7-43f6-97ad-909e7569a97b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Request method failure captured: Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 HTTP/1.1 Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mXh0wloqivlKTpkBNiD0FOFLHIZyXKcsZJzySbmGUQ8hR0gGh-XabyEUGCVut0Zb-W6k661_ZfaqEplP8kTCnHA_8nHG5jPZLbAMEc3OTpbfsxSl2i4g-BhfL6yvp4_v5urKFqVSmi8FAxxna_hrjVzNov-Ncvie3wjoHzkqKGZorA Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: fbbed7fab4584f379dbefe4af9826544 Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:18:36.543127 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:18:36.544790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fbbed7fab4584f379dbefe4af9826544", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fbbed7fab4584f379dbefe4af9826544"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:18:36.544790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:36.544790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: fbbed7fab4584f379dbefe4af9826544 Aug 03 12:18:36.544790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1781968059 Aug 03 12:18:36.544790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-AttachVolumeShelveTestJSON-1781968059-project Aug 03 12:18:36.544790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:18:36.544790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:18:36.544790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 42ce2627c0f142f8892c182f69ef9a39 Aug 03 12:18:36.544790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1781968059-project Aug 03 12:18:36.544790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:18:36.544790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:18:36.544790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': '4afb38cd-ec9c-4509-b7c8-91b170684ec5'} Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:18:36.545662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. Aug 03 12:18:36.547133 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:18:36.550558 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0655a24b-31a7-43f6-97ad-909e7569a97b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] Returning 404 to user: Instance 4afb38cd-ec9c-4509-b7c8-91b170684ec5 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:18:36.555579 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0655a24b-31a7-43f6-97ad-909e7569a97b tempest-AttachVolumeShelveTestJSON-1781968059 tempest-AttachVolumeShelveTestJSON-1781968059-project] 10.222.0.17 "GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5" status: 404 len: 111 microversion: 2.20 time: 0.066215 Aug 03 12:18:36.558523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 462/889] 10.222.0.17 () {60 vars in 1277 bytes} [Wed Aug 3 12:18:36 2022] GET /compute/v2.1/servers/4afb38cd-ec9c-4509-b7c8-91b170684ec5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 03 12:19:05.158179 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-621396711", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1695578460", "security_groups": [{"name": "tempest-secgroup-smoke-1652712651"}], "block_device_mapping_v2": [{"uuid": "ccbe2cdb-74d4-4df7-b946-51eff7049cb5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a7bb6085-454f-4cb3-bcae-1c152bc4a607"}]}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:19:05.167937 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:05.168596 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:05.276254 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.network.neutron [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] validate_networks() for [('a7bb6085-454f-4cb3-bcae-1c152bc4a607', None, None, None, None, None)] {{(pid=117911) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:19:05.709467 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Flavor limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:19:05.710032 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Image limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:19:05.710789 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Flavor pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:19:05.711415 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Image pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:19:05.712174 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:19:05.722294 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:05.722782 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:05.723656 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:05.724034 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:05.743198 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Getting quotas for project 1a4c09dba5b24ef5b37b730b259d3790. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:19:05.747821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Getting quotas for user 5cf524f6288040219c0492d3a794e830 and project 1a4c09dba5b24ef5b37b730b259d3790. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:19:05.808206 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Going to run 1 instances... {{(pid=117911) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:19:05.810287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ccbe2cdb-74d4-4df7-b946-51eff7049cb5',volume_size=None,volume_type=None)] {{(pid=117911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:19:05.948580 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-300f4a60-6979-4409-8d3f-b12a27cff7a4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.794415 Aug 03 12:19:05.955105 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 428/890] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:19:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:19:05.960761 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0f9a1fce-a8d4-4673-a673-2afda1e5ef42 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:05.961384 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0f9a1fce-a8d4-4673-a673-2afda1e5ef42 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:05.963891 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=35 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:05.964600 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:06.029567 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0f9a1fce-a8d4-4673-a673-2afda1e5ef42 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:06.036354 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0f9a1fce-a8d4-4673-a673-2afda1e5ef42 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1094 microversion: 2.1 time: 0.079933 Aug 03 12:19:06.037164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 463/891] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:05 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:07.057227 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-78f1aef9-0a97-4016-8040-90efb2daa1f4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:07.057836 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-78f1aef9-0a97-4016-8040-90efb2daa1f4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:07.065416 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-78f1aef9-0a97-4016-8040-90efb2daa1f4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:07.065865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-78f1aef9-0a97-4016-8040-90efb2daa1f4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:07.066665 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-78f1aef9-0a97-4016-8040-90efb2daa1f4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:07.067103 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-78f1aef9-0a97-4016-8040-90efb2daa1f4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:07.127146 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-78f1aef9-0a97-4016-8040-90efb2daa1f4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:07.135009 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-78f1aef9-0a97-4016-8040-90efb2daa1f4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1144 microversion: 2.1 time: 0.081753 Aug 03 12:19:07.135561 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 429/892] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:07 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:08.155830 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-43102690-fdcd-4e41-bbea-2065147f4053 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:08.156446 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-43102690-fdcd-4e41-bbea-2065147f4053 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:08.163003 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43102690-fdcd-4e41-bbea-2065147f4053 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:08.163457 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43102690-fdcd-4e41-bbea-2065147f4053 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:08.164808 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43102690-fdcd-4e41-bbea-2065147f4053 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:08.165249 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-43102690-fdcd-4e41-bbea-2065147f4053 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:08.229022 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-43102690-fdcd-4e41-bbea-2065147f4053 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:08.236503 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-43102690-fdcd-4e41-bbea-2065147f4053 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1136 microversion: 2.1 time: 0.084636 Aug 03 12:19:08.237063 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 464/893] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:08 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1136 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:09.257377 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-23f8569f-f557-41ec-a715-82bf0a356d38 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:09.257994 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-23f8569f-f557-41ec-a715-82bf0a356d38 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:09.264630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-23f8569f-f557-41ec-a715-82bf0a356d38 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:09.265029 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-23f8569f-f557-41ec-a715-82bf0a356d38 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:09.265800 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-23f8569f-f557-41ec-a715-82bf0a356d38 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:09.266246 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-23f8569f-f557-41ec-a715-82bf0a356d38 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:09.349592 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-23f8569f-f557-41ec-a715-82bf0a356d38 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:09.357688 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-23f8569f-f557-41ec-a715-82bf0a356d38 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1210 microversion: 2.1 time: 0.104330 Aug 03 12:19:09.358264 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 430/894] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:09 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:10.379298 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f99232ca-5e4c-4175-8d9d-19405fdaabf8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:10.379908 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f99232ca-5e4c-4175-8d9d-19405fdaabf8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:10.387208 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f99232ca-5e4c-4175-8d9d-19405fdaabf8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:10.387670 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f99232ca-5e4c-4175-8d9d-19405fdaabf8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:10.388445 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f99232ca-5e4c-4175-8d9d-19405fdaabf8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:10.388887 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f99232ca-5e4c-4175-8d9d-19405fdaabf8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:10.520614 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f99232ca-5e4c-4175-8d9d-19405fdaabf8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:10.528120 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f99232ca-5e4c-4175-8d9d-19405fdaabf8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1278 microversion: 2.1 time: 0.152721 Aug 03 12:19:10.528685 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 465/895] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:10 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:11.357269 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-9f8601d5-b019-4130-8c48-a7f7aec08036 req-37c04688-a9fd-4f35-af2e-ddbbce8ef2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c08ce8fa-c489-489c-9764-f7ddf318ea36", "tag": "624df27a-2568-4e4e-92e7-202eb93b895e"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:19:11.368152 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-9f8601d5-b019-4130-8c48-a7f7aec08036 req-37c04688-a9fd-4f35-af2e-ddbbce8ef2fa service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:11.368504 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-9f8601d5-b019-4130-8c48-a7f7aec08036 req-37c04688-a9fd-4f35-af2e-ddbbce8ef2fa service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:11.379618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-9f8601d5-b019-4130-8c48-a7f7aec08036 req-37c04688-a9fd-4f35-af2e-ddbbce8ef2fa service nova] Creating event network-changed:624df27a-2568-4e4e-92e7-202eb93b895e for instance c08ce8fa-c489-489c-9764-f7ddf318ea36 on hv-cinder-83602 Aug 03 12:19:11.385172 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-9f8601d5-b019-4130-8c48-a7f7aec08036 req-37c04688-a9fd-4f35-af2e-ddbbce8ef2fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031519 Aug 03 12:19:11.385978 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 431/896] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:19:11.548284 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-090bcfd5-b401-4bed-9bbc-b03a9b77fb17 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:11.548894 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-090bcfd5-b401-4bed-9bbc-b03a9b77fb17 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:11.555462 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-090bcfd5-b401-4bed-9bbc-b03a9b77fb17 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:11.555916 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-090bcfd5-b401-4bed-9bbc-b03a9b77fb17 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:11.556724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-090bcfd5-b401-4bed-9bbc-b03a9b77fb17 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:11.557167 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-090bcfd5-b401-4bed-9bbc-b03a9b77fb17 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:11.692262 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-090bcfd5-b401-4bed-9bbc-b03a9b77fb17 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:11.700589 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-090bcfd5-b401-4bed-9bbc-b03a9b77fb17 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1278 microversion: 2.1 time: 0.156156 Aug 03 12:19:11.701173 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 466/897] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:11 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:12.723401 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-fc2a66b8-3698-4501-a892-4b67f94da1c4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:12.724227 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-fc2a66b8-3698-4501-a892-4b67f94da1c4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:12.731934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fc2a66b8-3698-4501-a892-4b67f94da1c4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:12.732392 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fc2a66b8-3698-4501-a892-4b67f94da1c4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:12.733177 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fc2a66b8-3698-4501-a892-4b67f94da1c4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:12.733788 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fc2a66b8-3698-4501-a892-4b67f94da1c4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:12.878545 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-fc2a66b8-3698-4501-a892-4b67f94da1c4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:12.886528 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-fc2a66b8-3698-4501-a892-4b67f94da1c4 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1266 microversion: 2.1 time: 0.168672 Aug 03 12:19:12.887226 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 432/898] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:12 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:13.910052 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-dab8e284-c0c1-45fb-a3cf-3f5c80ef2bff tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:13.910753 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-dab8e284-c0c1-45fb-a3cf-3f5c80ef2bff tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:13.918107 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dab8e284-c0c1-45fb-a3cf-3f5c80ef2bff tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:13.918682 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dab8e284-c0c1-45fb-a3cf-3f5c80ef2bff tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:13.919517 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dab8e284-c0c1-45fb-a3cf-3f5c80ef2bff tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:13.920020 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-dab8e284-c0c1-45fb-a3cf-3f5c80ef2bff tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:14.056049 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-dab8e284-c0c1-45fb-a3cf-3f5c80ef2bff tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:14.063680 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-dab8e284-c0c1-45fb-a3cf-3f5c80ef2bff tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1266 microversion: 2.1 time: 0.157656 Aug 03 12:19:14.064262 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 467/899] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:13 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:15.084503 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ed31b9b4-097c-4844-bb1d-1a656ac74d33 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:15.085160 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-ed31b9b4-097c-4844-bb1d-1a656ac74d33 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:15.091869 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ed31b9b4-097c-4844-bb1d-1a656ac74d33 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:15.092323 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ed31b9b4-097c-4844-bb1d-1a656ac74d33 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:15.093101 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ed31b9b4-097c-4844-bb1d-1a656ac74d33 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:15.093544 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ed31b9b4-097c-4844-bb1d-1a656ac74d33 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:15.234057 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ed31b9b4-097c-4844-bb1d-1a656ac74d33 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:15.242436 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ed31b9b4-097c-4844-bb1d-1a656ac74d33 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1266 microversion: 2.1 time: 0.161237 Aug 03 12:19:15.243043 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 433/900] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:15 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:16.263643 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c2f47fbb-f997-471a-b72e-d2678350ec8a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:16.264255 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c2f47fbb-f997-471a-b72e-d2678350ec8a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:16.266800 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:16.272560 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c2f47fbb-f997-471a-b72e-d2678350ec8a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:16.273515 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c2f47fbb-f997-471a-b72e-d2678350ec8a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:16.274305 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c2f47fbb-f997-471a-b72e-d2678350ec8a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:16.274781 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c2f47fbb-f997-471a-b72e-d2678350ec8a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:16.411937 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c2f47fbb-f997-471a-b72e-d2678350ec8a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:16.419964 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c2f47fbb-f997-471a-b72e-d2678350ec8a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1266 microversion: 2.1 time: 0.160127 Aug 03 12:19:16.420466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 468/901] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:16 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:17.440396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-600d21b7-151d-4c38-b722-cf1473024e3f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:17.441040 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-600d21b7-151d-4c38-b722-cf1473024e3f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:17.443033 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:17.443856 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=6 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:17.449998 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-600d21b7-151d-4c38-b722-cf1473024e3f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:17.450466 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-600d21b7-151d-4c38-b722-cf1473024e3f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:17.451252 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-600d21b7-151d-4c38-b722-cf1473024e3f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:17.451695 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-600d21b7-151d-4c38-b722-cf1473024e3f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:17.591515 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-600d21b7-151d-4c38-b722-cf1473024e3f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:17.599298 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-600d21b7-151d-4c38-b722-cf1473024e3f tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1266 microversion: 2.1 time: 0.162794 Aug 03 12:19:17.599868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 434/902] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:17 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:18.621598 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9e30a57b-60bd-48c3-a289-7e3152ddd3b8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:18.622348 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9e30a57b-60bd-48c3-a289-7e3152ddd3b8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:18.629815 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9e30a57b-60bd-48c3-a289-7e3152ddd3b8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:18.630255 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9e30a57b-60bd-48c3-a289-7e3152ddd3b8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:18.631063 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9e30a57b-60bd-48c3-a289-7e3152ddd3b8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:18.631617 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9e30a57b-60bd-48c3-a289-7e3152ddd3b8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:18.775253 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9e30a57b-60bd-48c3-a289-7e3152ddd3b8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:18.783183 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9e30a57b-60bd-48c3-a289-7e3152ddd3b8 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1266 microversion: 2.1 time: 0.166688 Aug 03 12:19:18.783755 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 469/903] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:18 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:19.804479 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d31f8f26-5fd9-48ed-89f6-b5f97adc7b22 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:19.805100 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d31f8f26-5fd9-48ed-89f6-b5f97adc7b22 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:19.813128 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d31f8f26-5fd9-48ed-89f6-b5f97adc7b22 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:19.814262 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d31f8f26-5fd9-48ed-89f6-b5f97adc7b22 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:19.815126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d31f8f26-5fd9-48ed-89f6-b5f97adc7b22 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:19.815691 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d31f8f26-5fd9-48ed-89f6-b5f97adc7b22 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:19.962003 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d31f8f26-5fd9-48ed-89f6-b5f97adc7b22 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:19.971269 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d31f8f26-5fd9-48ed-89f6-b5f97adc7b22 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1266 microversion: 2.1 time: 0.170604 Aug 03 12:19:19.972151 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 435/904] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:19 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:19:20.992105 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ee1bbf5a-54cf-48c2-9562-49aa6443cdd7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:20.992666 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ee1bbf5a-54cf-48c2-9562-49aa6443cdd7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:20.999882 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ee1bbf5a-54cf-48c2-9562-49aa6443cdd7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:21.000337 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ee1bbf5a-54cf-48c2-9562-49aa6443cdd7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:21.001130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ee1bbf5a-54cf-48c2-9562-49aa6443cdd7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:21.001571 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ee1bbf5a-54cf-48c2-9562-49aa6443cdd7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:21.134763 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ee1bbf5a-54cf-48c2-9562-49aa6443cdd7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:21.142076 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ee1bbf5a-54cf-48c2-9562-49aa6443cdd7 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1266 microversion: 2.1 time: 0.153973 Aug 03 12:19:21.142661 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 470/905] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:20 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:21.889695 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-2a9584f9-e460-4bda-bd5c-3487118f29cb req-2ace19cc-e367-4ac6-acd5-dce8fde71904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08ce8fa-c489-489c-9764-f7ddf318ea36", "name": "network-vif-plugged", "status": "completed", "tag": "624df27a-2568-4e4e-92e7-202eb93b895e"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:19:21.903444 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-2a9584f9-e460-4bda-bd5c-3487118f29cb req-2ace19cc-e367-4ac6-acd5-dce8fde71904 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:21.905719 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-2a9584f9-e460-4bda-bd5c-3487118f29cb req-2ace19cc-e367-4ac6-acd5-dce8fde71904 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:21.918193 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-2a9584f9-e460-4bda-bd5c-3487118f29cb req-2ace19cc-e367-4ac6-acd5-dce8fde71904 service nova] Creating event network-vif-plugged:624df27a-2568-4e4e-92e7-202eb93b895e for instance c08ce8fa-c489-489c-9764-f7ddf318ea36 on hv-cinder-83602 Aug 03 12:19:21.923539 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-2a9584f9-e460-4bda-bd5c-3487118f29cb req-2ace19cc-e367-4ac6-acd5-dce8fde71904 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037954 Aug 03 12:19:21.924433 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 436/906] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:19:22.163193 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2fa10e69-abb3-4247-b959-6b9c6a35e866 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:22.164605 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2fa10e69-abb3-4247-b959-6b9c6a35e866 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:22.172077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2fa10e69-abb3-4247-b959-6b9c6a35e866 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:22.172871 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2fa10e69-abb3-4247-b959-6b9c6a35e866 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:22.173920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2fa10e69-abb3-4247-b959-6b9c6a35e866 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:22.174593 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2fa10e69-abb3-4247-b959-6b9c6a35e866 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:22.346650 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2fa10e69-abb3-4247-b959-6b9c6a35e866 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:22.354877 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2fa10e69-abb3-4247-b959-6b9c6a35e866 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1266 microversion: 2.1 time: 0.195589 Aug 03 12:19:22.355461 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 471/907] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:22 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:23.377392 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-febadde0-9c38-4500-b17d-989bbca5140d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:23.378108 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-febadde0-9c38-4500-b17d-989bbca5140d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:23.385617 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-febadde0-9c38-4500-b17d-989bbca5140d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:23.386167 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-febadde0-9c38-4500-b17d-989bbca5140d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:23.387016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-febadde0-9c38-4500-b17d-989bbca5140d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:23.387461 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-febadde0-9c38-4500-b17d-989bbca5140d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:23.577258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-febadde0-9c38-4500-b17d-989bbca5140d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:23.585087 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-febadde0-9c38-4500-b17d-989bbca5140d tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1454 microversion: 2.1 time: 0.212057 Aug 03 12:19:23.586106 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 437/908] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:23 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1454 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:23.609440 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4b7982ff-8dd0-4535-8130-53efc9cb20c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:23.610150 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4b7982ff-8dd0-4535-8130-53efc9cb20c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:23.617088 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b7982ff-8dd0-4535-8130-53efc9cb20c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:23.617613 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b7982ff-8dd0-4535-8130-53efc9cb20c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:23.619049 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b7982ff-8dd0-4535-8130-53efc9cb20c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:23.619642 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b7982ff-8dd0-4535-8130-53efc9cb20c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:23.773728 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4b7982ff-8dd0-4535-8130-53efc9cb20c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:23.782266 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4b7982ff-8dd0-4535-8130-53efc9cb20c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1454 microversion: 2.1 time: 0.178555 Aug 03 12:19:23.782882 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 472/909] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:23 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:25.696778 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-7fc9153c-519f-4970-a9ec-7bba7c6966b2 req-494cd515-bc65-42ec-8046-7d427db856a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c08ce8fa-c489-489c-9764-f7ddf318ea36", "tag": "624df27a-2568-4e4e-92e7-202eb93b895e"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:19:25.707834 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-7fc9153c-519f-4970-a9ec-7bba7c6966b2 req-494cd515-bc65-42ec-8046-7d427db856a4 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:25.708551 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-7fc9153c-519f-4970-a9ec-7bba7c6966b2 req-494cd515-bc65-42ec-8046-7d427db856a4 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:25.722520 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-7fc9153c-519f-4970-a9ec-7bba7c6966b2 req-494cd515-bc65-42ec-8046-7d427db856a4 service nova] Creating event network-changed:624df27a-2568-4e4e-92e7-202eb93b895e for instance c08ce8fa-c489-489c-9764-f7ddf318ea36 on hv-cinder-83602 Aug 03 12:19:25.731471 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-7fc9153c-519f-4970-a9ec-7bba7c6966b2 req-494cd515-bc65-42ec-8046-7d427db856a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038328 Aug 03 12:19:25.732276 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 438/910] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:19:28.384960 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1698688977", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "networks": [{"uuid": "e350374f-d070-48c6-a07c-cb07105b3744"}]}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:19:28.437712 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] validate_networks() for [('e350374f-d070-48c6-a07c-cb07105b3744', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:19:28.797100 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:19:28.797574 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:19:28.798061 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:19:28.798501 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:19:28.798939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:19:28.808555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:28.809004 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:28.809803 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:28.810239 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:28.827176 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Getting quotas for project 20296a9e3969428f9d487f021f06e524. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:19:28.831138 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Getting quotas for user 5dfc8cbb23024495934b76d07b281996 and project 20296a9e3969428f9d487f021f06e524. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:19:28.842402 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:19:28.844704 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:19:28.890100 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8616baa0-95a1-49ec-b155-db34257bdf37 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509510 Aug 03 12:19:28.890687 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 473/911] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:19:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:19:28.902785 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a3000c5f-98c6-458c-b60f-7de3516ff989 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:28.903730 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a3000c5f-98c6-458c-b60f-7de3516ff989 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:28.965117 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a3000c5f-98c6-458c-b60f-7de3516ff989 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:28.972169 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a3000c5f-98c6-458c-b60f-7de3516ff989 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 200 len: 1214 microversion: 2.1 time: 0.073896 Aug 03 12:19:28.972878 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 439/912] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:28 2022] GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:29.994259 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ed0e5154-9120-4579-85dd-d60373a55b2c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:29.995159 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ed0e5154-9120-4579-85dd-d60373a55b2c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:30.004310 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed0e5154-9120-4579-85dd-d60373a55b2c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:30.004920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed0e5154-9120-4579-85dd-d60373a55b2c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:30.005803 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed0e5154-9120-4579-85dd-d60373a55b2c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:30.006349 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ed0e5154-9120-4579-85dd-d60373a55b2c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:30.076009 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ed0e5154-9120-4579-85dd-d60373a55b2c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:30.083637 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ed0e5154-9120-4579-85dd-d60373a55b2c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 200 len: 1272 microversion: 2.1 time: 0.093898 Aug 03 12:19:30.084215 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 474/913] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:29 2022] GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:31.106800 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f8899c99-e8cf-4ea5-bcda-4bc2926c8dc7 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:31.107687 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f8899c99-e8cf-4ea5-bcda-4bc2926c8dc7 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:31.115804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f8899c99-e8cf-4ea5-bcda-4bc2926c8dc7 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:31.116256 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f8899c99-e8cf-4ea5-bcda-4bc2926c8dc7 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:31.117210 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f8899c99-e8cf-4ea5-bcda-4bc2926c8dc7 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:31.117698 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f8899c99-e8cf-4ea5-bcda-4bc2926c8dc7 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:31.601752 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-117d0bbf-7d7d-4a7a-81ec-f916b1376f76 req-6174f811-d8b2-404b-8ac4-a5208193bff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecea8b3a-f9c5-4fc1-abee-f90698da7d9d", "tag": "792bd1ec-ca98-4baa-98b3-3bc335e16a5a"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:19:31.613579 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-117d0bbf-7d7d-4a7a-81ec-f916b1376f76 req-6174f811-d8b2-404b-8ac4-a5208193bff6 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:31.613579 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-117d0bbf-7d7d-4a7a-81ec-f916b1376f76 req-6174f811-d8b2-404b-8ac4-a5208193bff6 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:31.624261 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f8899c99-e8cf-4ea5-bcda-4bc2926c8dc7 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:31.626724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-117d0bbf-7d7d-4a7a-81ec-f916b1376f76 req-6174f811-d8b2-404b-8ac4-a5208193bff6 service nova] Creating event network-changed:792bd1ec-ca98-4baa-98b3-3bc335e16a5a for instance ecea8b3a-f9c5-4fc1-abee-f90698da7d9d on hv-cinder-83602 Aug 03 12:19:31.632056 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-117d0bbf-7d7d-4a7a-81ec-f916b1376f76 req-6174f811-d8b2-404b-8ac4-a5208193bff6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033942 Aug 03 12:19:31.633360 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 475/914] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:19:31.634077 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f8899c99-e8cf-4ea5-bcda-4bc2926c8dc7 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 200 len: 1314 microversion: 2.1 time: 0.532448 Aug 03 12:19:31.647849 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 440/915] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:31 2022] GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:32.657178 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-bb153966-47ca-41c4-9b1d-cc870ef584be tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:32.657788 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-bb153966-47ca-41c4-9b1d-cc870ef584be tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:32.664791 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bb153966-47ca-41c4-9b1d-cc870ef584be tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:32.665240 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bb153966-47ca-41c4-9b1d-cc870ef584be tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:32.666016 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bb153966-47ca-41c4-9b1d-cc870ef584be tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:32.666474 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-bb153966-47ca-41c4-9b1d-cc870ef584be tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:32.800427 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-bb153966-47ca-41c4-9b1d-cc870ef584be tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:32.808720 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-bb153966-47ca-41c4-9b1d-cc870ef584be tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 200 len: 1314 microversion: 2.1 time: 0.155751 Aug 03 12:19:32.809305 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 476/916] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:32 2022] GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:33.830740 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-51b7759a-a5be-4a25-81d8-3f478da71c5f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:33.831350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-51b7759a-a5be-4a25-81d8-3f478da71c5f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:33.839062 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-51b7759a-a5be-4a25-81d8-3f478da71c5f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:33.839518 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-51b7759a-a5be-4a25-81d8-3f478da71c5f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:33.840293 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-51b7759a-a5be-4a25-81d8-3f478da71c5f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:33.840739 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-51b7759a-a5be-4a25-81d8-3f478da71c5f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:33.995247 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-51b7759a-a5be-4a25-81d8-3f478da71c5f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:34.002984 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-51b7759a-a5be-4a25-81d8-3f478da71c5f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 200 len: 1314 microversion: 2.1 time: 0.176828 Aug 03 12:19:34.003567 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 441/917] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:33 2022] GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:35.025626 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-764136a8-7b04-49df-824c-1df55f071637 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:35.026273 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-764136a8-7b04-49df-824c-1df55f071637 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:35.032732 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-764136a8-7b04-49df-824c-1df55f071637 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:35.033174 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-764136a8-7b04-49df-824c-1df55f071637 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:35.033929 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-764136a8-7b04-49df-824c-1df55f071637 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:35.034361 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-764136a8-7b04-49df-824c-1df55f071637 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:35.169797 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-764136a8-7b04-49df-824c-1df55f071637 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:35.177448 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-764136a8-7b04-49df-824c-1df55f071637 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 200 len: 1314 microversion: 2.1 time: 0.155674 Aug 03 12:19:35.178012 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 477/918] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:35 2022] GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:35.941923 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-86ebe598-f4ff-4348-9e5e-3f7f50d32fcd req-81cf6b9e-4a76-4474-a577-72e2d119a352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecea8b3a-f9c5-4fc1-abee-f90698da7d9d", "name": "network-vif-plugged", "status": "completed", "tag": "792bd1ec-ca98-4baa-98b3-3bc335e16a5a"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:19:35.947504 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:35.954577 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-86ebe598-f4ff-4348-9e5e-3f7f50d32fcd req-81cf6b9e-4a76-4474-a577-72e2d119a352 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:35.955636 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-86ebe598-f4ff-4348-9e5e-3f7f50d32fcd req-81cf6b9e-4a76-4474-a577-72e2d119a352 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:35.960536 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=63 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:35.969814 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-86ebe598-f4ff-4348-9e5e-3f7f50d32fcd req-81cf6b9e-4a76-4474-a577-72e2d119a352 service nova] Creating event network-vif-plugged:792bd1ec-ca98-4baa-98b3-3bc335e16a5a for instance ecea8b3a-f9c5-4fc1-abee-f90698da7d9d on hv-cinder-83602 Aug 03 12:19:35.975112 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-86ebe598-f4ff-4348-9e5e-3f7f50d32fcd req-81cf6b9e-4a76-4474-a577-72e2d119a352 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037036 Aug 03 12:19:35.976052 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 442/919] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:19:36.201451 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-3d9747ef-9ea1-4990-9531-b6b4647c53c5 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:36.202197 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-3d9747ef-9ea1-4990-9531-b6b4647c53c5 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:36.204634 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:36.210061 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3d9747ef-9ea1-4990-9531-b6b4647c53c5 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:36.211097 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3d9747ef-9ea1-4990-9531-b6b4647c53c5 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:36.211922 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3d9747ef-9ea1-4990-9531-b6b4647c53c5 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:36.212365 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-3d9747ef-9ea1-4990-9531-b6b4647c53c5 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:36.217672 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=77 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:36.345513 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-3d9747ef-9ea1-4990-9531-b6b4647c53c5 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:36.353661 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-3d9747ef-9ea1-4990-9531-b6b4647c53c5 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 200 len: 1314 microversion: 2.1 time: 0.156064 Aug 03 12:19:36.354249 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 478/920] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:36 2022] GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:37.376577 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4d045b47-171a-4f6d-8b5a-125ce6468257 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:37.377445 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-4d045b47-171a-4f6d-8b5a-125ce6468257 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:37.384603 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4d045b47-171a-4f6d-8b5a-125ce6468257 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:37.385058 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4d045b47-171a-4f6d-8b5a-125ce6468257 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:37.385874 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4d045b47-171a-4f6d-8b5a-125ce6468257 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:37.386346 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4d045b47-171a-4f6d-8b5a-125ce6468257 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:37.528261 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-4d045b47-171a-4f6d-8b5a-125ce6468257 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:37.536336 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-4d045b47-171a-4f6d-8b5a-125ce6468257 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 200 len: 1314 microversion: 2.1 time: 0.164469 Aug 03 12:19:37.536758 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 443/921] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:37 2022] GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:19:38.557334 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a5631a10-9f76-414b-a452-a932a787f35f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:38.557945 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a5631a10-9f76-414b-a452-a932a787f35f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:38.564362 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a5631a10-9f76-414b-a452-a932a787f35f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:38.564802 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a5631a10-9f76-414b-a452-a932a787f35f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:38.565547 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a5631a10-9f76-414b-a452-a932a787f35f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:38.565975 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a5631a10-9f76-414b-a452-a932a787f35f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:38.697529 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-a5631a10-9f76-414b-a452-a932a787f35f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:38.704908 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a5631a10-9f76-414b-a452-a932a787f35f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 200 len: 1498 microversion: 2.1 time: 0.151455 Aug 03 12:19:38.705471 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 479/922] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:38 2022] GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:41.477023 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a016cd33-bacc-4e7a-9e70-68f1c464be10 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:41.477575 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a016cd33-bacc-4e7a-9e70-68f1c464be10 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:41.480065 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:41.485794 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a016cd33-bacc-4e7a-9e70-68f1c464be10 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:41.486256 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a016cd33-bacc-4e7a-9e70-68f1c464be10 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:41.487066 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a016cd33-bacc-4e7a-9e70-68f1c464be10 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:41.487514 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a016cd33-bacc-4e7a-9e70-68f1c464be10 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:41.513448 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a016cd33-bacc-4e7a-9e70-68f1c464be10 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Going to try to terminate instance {{(pid=117911) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:19:41.587253 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a016cd33-bacc-4e7a-9e70-68f1c464be10 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 204 len: 0 microversion: 2.1 time: 0.114196 Aug 03 12:19:41.587999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 444/923] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:19:41 2022] DELETE /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:19:41.596113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-45d75f10-b681-4271-a02e-540bf487f90d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:41.596739 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-45d75f10-b681-4271-a02e-540bf487f90d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:41.598589 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:41.599246 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:41.605939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45d75f10-b681-4271-a02e-540bf487f90d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:41.606415 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45d75f10-b681-4271-a02e-540bf487f90d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:41.607225 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45d75f10-b681-4271-a02e-540bf487f90d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:41.607659 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-45d75f10-b681-4271-a02e-540bf487f90d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:41.735778 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-45d75f10-b681-4271-a02e-540bf487f90d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:41.743242 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-45d75f10-b681-4271-a02e-540bf487f90d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 200 len: 1504 microversion: 2.1 time: 0.151195 Aug 03 12:19:41.743812 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 480/924] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:41 2022] GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:19:42.764703 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e6852040-166d-4349-9e4e-7f72f735cc7f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:42.765403 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e6852040-166d-4349-9e4e-7f72f735cc7f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:42.772148 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e6852040-166d-4349-9e4e-7f72f735cc7f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:42.772592 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e6852040-166d-4349-9e4e-7f72f735cc7f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:42.773352 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e6852040-166d-4349-9e4e-7f72f735cc7f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:42.774281 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e6852040-166d-4349-9e4e-7f72f735cc7f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:42.920697 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e6852040-166d-4349-9e4e-7f72f735cc7f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:42.929029 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e6852040-166d-4349-9e4e-7f72f735cc7f tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 200 len: 1504 microversion: 2.1 time: 0.168455 Aug 03 12:19:42.929613 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 445/925] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:42 2022] GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:43.775352 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-2c41c7e8-2e2f-437d-ad12-4fc9af6d66e0 req-1e7b4f11-d0e2-459b-8ba0-ce619cee1c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecea8b3a-f9c5-4fc1-abee-f90698da7d9d", "name": "network-vif-deleted", "tag": "792bd1ec-ca98-4baa-98b3-3bc335e16a5a"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:19:43.785954 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-2c41c7e8-2e2f-437d-ad12-4fc9af6d66e0 req-1e7b4f11-d0e2-459b-8ba0-ce619cee1c38 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:43.786404 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-2c41c7e8-2e2f-437d-ad12-4fc9af6d66e0 req-1e7b4f11-d0e2-459b-8ba0-ce619cee1c38 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:43.799238 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-2c41c7e8-2e2f-437d-ad12-4fc9af6d66e0 req-1e7b4f11-d0e2-459b-8ba0-ce619cee1c38 service nova] Creating event network-vif-deleted:792bd1ec-ca98-4baa-98b3-3bc335e16a5a for instance ecea8b3a-f9c5-4fc1-abee-f90698da7d9d on hv-cinder-83602 Aug 03 12:19:43.804144 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-2c41c7e8-2e2f-437d-ad12-4fc9af6d66e0 req-1e7b4f11-d0e2-459b-8ba0-ce619cee1c38 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032454 Aug 03 12:19:43.805527 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 481/926] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:19:43.951527 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5c651f7a-15c9-4ffd-b1ee-9b45897dbee0 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:43.952145 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5c651f7a-15c9-4ffd-b1ee-9b45897dbee0 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:43.958674 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c651f7a-15c9-4ffd-b1ee-9b45897dbee0 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:43.959121 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c651f7a-15c9-4ffd-b1ee-9b45897dbee0 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:43.959893 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c651f7a-15c9-4ffd-b1ee-9b45897dbee0 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:43.960330 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c651f7a-15c9-4ffd-b1ee-9b45897dbee0 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:43.991812 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c651f7a-15c9-4ffd-b1ee-9b45897dbee0 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:43.992178 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c651f7a-15c9-4ffd-b1ee-9b45897dbee0 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:43.992641 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-5c651f7a-15c9-4ffd-b1ee-9b45897dbee0 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lazy-loading 'fault' on Instance uuid ecea8b3a-f9c5-4fc1-abee-f90698da7d9d {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:19:44.035658 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5c651f7a-15c9-4ffd-b1ee-9b45897dbee0 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:44.043867 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5c651f7a-15c9-4ffd-b1ee-9b45897dbee0 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 200 len: 1304 microversion: 2.1 time: 0.096295 Aug 03 12:19:44.044436 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 446/927] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:43 2022] GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:45.065587 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a38188c8-891c-4903-bf58-7b10e4b5c26d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:45.066194 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-a38188c8-891c-4903-bf58-7b10e4b5c26d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: ecea8b3a-f9c5-4fc1-abee-f90698da7d9d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:45.073862 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a38188c8-891c-4903-bf58-7b10e4b5c26d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:45.074343 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a38188c8-891c-4903-bf58-7b10e4b5c26d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:45.075171 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a38188c8-891c-4903-bf58-7b10e4b5c26d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:45.075603 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-a38188c8-891c-4903-bf58-7b10e4b5c26d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:45.089520 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-a38188c8-891c-4903-bf58-7b10e4b5c26d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] HTTP exception thrown: Instance ecea8b3a-f9c5-4fc1-abee-f90698da7d9d could not be found. Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a38188c8-891c-4903-bf58-7b10e4b5c26d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Request method failure captured: Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d HTTP/1.1 Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mfOfFjMIGHWSBnV4DLYbmQxyJPv4dbf-7BT8QzFnfTBmU3k9NMwqFkyAWglMf2rr9OHODv4hRx9IBY87vyWKf2ccyifb9-btv_VEZQMJXyfHh4Mjb-rgxIF55xRHjKboLmnD08GG1A110J2D-eLmochbF7g0Y1dlfpR-ze1MTQMesM Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 20296a9e3969428f9d487f021f06e524 Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesActionsTest-1098657149 Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:19:45.091206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:19:45.092905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_20296a9e3969428f9d487f021f06e524", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/20296a9e3969428f9d487f021f06e524"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20296a9e3969428f9d487f021f06e524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20296a9e3969428f9d487f021f06e524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:19:45.092905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesActionsTest-1098657149 Aug 03 12:19:45.092905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 20296a9e3969428f9d487f021f06e524 Aug 03 12:19:45.092905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesActionsTest-1098657149 Aug 03 12:19:45.092905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesActionsTest-1098657149-project Aug 03 12:19:45.092905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:19:45.092905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:19:45.092905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 5dfc8cbb23024495934b76d07b281996 Aug 03 12:19:45.092905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesActionsTest-1098657149-project Aug 03 12:19:45.092905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:19:45.092905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance ecea8b3a-f9c5-4fc1-abee-f90698da7d9d could not be found. Aug 03 12:19:45.092905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'ecea8b3a-f9c5-4fc1-abee-f90698da7d9d'} Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecea8b3a-f9c5-4fc1-abee-f90698da7d9d could not be found. Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:19:45.093774 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecea8b3a-f9c5-4fc1-abee-f90698da7d9d could not be found. Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecea8b3a-f9c5-4fc1-abee-f90698da7d9d could not be found. Aug 03 12:19:45.095123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:19:45.096294 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-a38188c8-891c-4903-bf58-7b10e4b5c26d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Returning 404 to user: Instance ecea8b3a-f9c5-4fc1-abee-f90698da7d9d could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:19:45.096294 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-a38188c8-891c-4903-bf58-7b10e4b5c26d tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d" status: 404 len: 111 microversion: 2.1 time: 0.031785 Aug 03 12:19:45.096294 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 482/928] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:45 2022] GET /compute/v2.1/servers/ecea8b3a-f9c5-4fc1-abee-f90698da7d9d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:19:45.141952 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1800570860", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "networks": [{"uuid": "e350374f-d070-48c6-a07c-cb07105b3744"}]}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:19:45.194942 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.network.neutron [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] validate_networks() for [('e350374f-d070-48c6-a07c-cb07105b3744', None, None, None, None, None)] {{(pid=117911) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:19:45.556113 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Flavor limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:19:45.556537 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Image limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:19:45.557017 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Flavor pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:19:45.557429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Image pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:19:45.557844 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:19:45.571905 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:45.572343 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:45.573129 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:45.573559 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:45.590541 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Getting quotas for project 20296a9e3969428f9d487f021f06e524. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:19:45.594375 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Getting quotas for user 5dfc8cbb23024495934b76d07b281996 and project 20296a9e3969428f9d487f021f06e524. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:19:45.606060 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Going to run 1 instances... {{(pid=117911) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:19:45.608344 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:19:45.654839 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-0d79d816-2390-4167-9785-de295e974662 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516505 Aug 03 12:19:45.655489 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 447/929] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:19:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:19:45.666503 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-7b28d91e-accb-4d62-9ac5-42fe64c8adb7 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:45.667368 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-7b28d91e-accb-4d62-9ac5-42fe64c8adb7 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:45.724285 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-7b28d91e-accb-4d62-9ac5-42fe64c8adb7 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:45.732472 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-7b28d91e-accb-4d62-9ac5-42fe64c8adb7 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1214 microversion: 2.1 time: 0.070141 Aug 03 12:19:45.733038 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 483/930] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:45 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:46.752275 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-bfa992d5-9c23-489e-a85d-fd4129660493 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:46.752900 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-bfa992d5-9c23-489e-a85d-fd4129660493 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:46.760109 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bfa992d5-9c23-489e-a85d-fd4129660493 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:46.760562 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bfa992d5-9c23-489e-a85d-fd4129660493 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:46.761334 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bfa992d5-9c23-489e-a85d-fd4129660493 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:46.761777 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-bfa992d5-9c23-489e-a85d-fd4129660493 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:46.822753 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-bfa992d5-9c23-489e-a85d-fd4129660493 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:46.830172 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-bfa992d5-9c23-489e-a85d-fd4129660493 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1218 microversion: 2.1 time: 0.081897 Aug 03 12:19:46.830770 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 448/931] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:46 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:47.850911 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-55b17c38-fd4a-4abb-9937-b3ffe476c732 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:47.851510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-55b17c38-fd4a-4abb-9937-b3ffe476c732 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:47.859269 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-55b17c38-fd4a-4abb-9937-b3ffe476c732 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:47.859715 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-55b17c38-fd4a-4abb-9937-b3ffe476c732 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:47.860472 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-55b17c38-fd4a-4abb-9937-b3ffe476c732 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:47.860905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-55b17c38-fd4a-4abb-9937-b3ffe476c732 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:47.923994 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-55b17c38-fd4a-4abb-9937-b3ffe476c732 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:47.931277 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-55b17c38-fd4a-4abb-9937-b3ffe476c732 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1210 microversion: 2.1 time: 0.084289 Aug 03 12:19:47.931834 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 484/932] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:47 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:48.952655 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d0f78b53-1b17-40af-82bb-7b0cb9971023 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:48.953268 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d0f78b53-1b17-40af-82bb-7b0cb9971023 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:48.960392 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d0f78b53-1b17-40af-82bb-7b0cb9971023 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:48.960848 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d0f78b53-1b17-40af-82bb-7b0cb9971023 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:48.962195 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d0f78b53-1b17-40af-82bb-7b0cb9971023 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:48.962687 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d0f78b53-1b17-40af-82bb-7b0cb9971023 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:49.032924 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d0f78b53-1b17-40af-82bb-7b0cb9971023 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:49.040349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d0f78b53-1b17-40af-82bb-7b0cb9971023 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1272 microversion: 2.1 time: 0.091707 Aug 03 12:19:49.040932 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 449/933] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:48 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:49.987883 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-a88ae9d2-e422-4ad9-a225-06b77afa2e7d req-ee34b9fc-5aae-41b1-a4e0-9f7eb3a17e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a47a2e45-a37e-48ba-9702-8f0847c04af6", "tag": "94c97318-e92c-4f53-83e1-3f7430bb194d"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:19:49.997887 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-a88ae9d2-e422-4ad9-a225-06b77afa2e7d req-ee34b9fc-5aae-41b1-a4e0-9f7eb3a17e2f service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:49.998326 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-a88ae9d2-e422-4ad9-a225-06b77afa2e7d req-ee34b9fc-5aae-41b1-a4e0-9f7eb3a17e2f service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:50.009802 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-a88ae9d2-e422-4ad9-a225-06b77afa2e7d req-ee34b9fc-5aae-41b1-a4e0-9f7eb3a17e2f service nova] Creating event network-changed:94c97318-e92c-4f53-83e1-3f7430bb194d for instance a47a2e45-a37e-48ba-9702-8f0847c04af6 on hv-cinder-83602 Aug 03 12:19:50.014559 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-a88ae9d2-e422-4ad9-a225-06b77afa2e7d req-ee34b9fc-5aae-41b1-a4e0-9f7eb3a17e2f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030422 Aug 03 12:19:50.015204 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 485/934] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:19:50.061124 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-91e945eb-51aa-4a8e-87a6-e87ea7ed9758 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:50.062009 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-91e945eb-51aa-4a8e-87a6-e87ea7ed9758 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:50.068397 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-91e945eb-51aa-4a8e-87a6-e87ea7ed9758 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:50.068859 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-91e945eb-51aa-4a8e-87a6-e87ea7ed9758 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:50.069680 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-91e945eb-51aa-4a8e-87a6-e87ea7ed9758 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:50.070252 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-91e945eb-51aa-4a8e-87a6-e87ea7ed9758 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:50.284845 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-91e945eb-51aa-4a8e-87a6-e87ea7ed9758 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:50.293397 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-91e945eb-51aa-4a8e-87a6-e87ea7ed9758 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1314 microversion: 2.1 time: 0.236145 Aug 03 12:19:50.294197 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 450/935] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:50 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:19:51.316306 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4111ff96-7b6a-43a9-be50-1c734212d5a1 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:51.317045 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4111ff96-7b6a-43a9-be50-1c734212d5a1 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:51.323247 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4111ff96-7b6a-43a9-be50-1c734212d5a1 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:51.323700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4111ff96-7b6a-43a9-be50-1c734212d5a1 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:51.324490 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4111ff96-7b6a-43a9-be50-1c734212d5a1 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:51.324930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4111ff96-7b6a-43a9-be50-1c734212d5a1 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:51.471686 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4111ff96-7b6a-43a9-be50-1c734212d5a1 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:51.481687 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4111ff96-7b6a-43a9-be50-1c734212d5a1 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1314 microversion: 2.1 time: 0.169988 Aug 03 12:19:51.482365 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 486/936] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:51 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:52.503480 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d6a56ede-0359-4a9c-b0c6-5c51acd5c2e3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:52.504121 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d6a56ede-0359-4a9c-b0c6-5c51acd5c2e3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:52.510333 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d6a56ede-0359-4a9c-b0c6-5c51acd5c2e3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:52.510819 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d6a56ede-0359-4a9c-b0c6-5c51acd5c2e3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:52.511580 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d6a56ede-0359-4a9c-b0c6-5c51acd5c2e3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:52.512014 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d6a56ede-0359-4a9c-b0c6-5c51acd5c2e3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:52.643535 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d6a56ede-0359-4a9c-b0c6-5c51acd5c2e3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:52.652349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d6a56ede-0359-4a9c-b0c6-5c51acd5c2e3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1314 microversion: 2.1 time: 0.152812 Aug 03 12:19:52.652934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 451/937] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:52 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:19:53.672988 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8bb5f49b-f53d-42c5-85f7-f679beb304ca tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:53.673599 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8bb5f49b-f53d-42c5-85f7-f679beb304ca tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:53.680162 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8bb5f49b-f53d-42c5-85f7-f679beb304ca tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:53.680602 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8bb5f49b-f53d-42c5-85f7-f679beb304ca tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:53.681347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8bb5f49b-f53d-42c5-85f7-f679beb304ca tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:53.681773 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8bb5f49b-f53d-42c5-85f7-f679beb304ca tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:53.810019 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8bb5f49b-f53d-42c5-85f7-f679beb304ca tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:53.817335 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8bb5f49b-f53d-42c5-85f7-f679beb304ca tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1314 microversion: 2.1 time: 0.148221 Aug 03 12:19:53.817899 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 487/938] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:53 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:54.838064 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-fc445f1b-08e2-4dca-b4fc-97a7621c80ea tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:54.838737 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-fc445f1b-08e2-4dca-b4fc-97a7621c80ea tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:54.845274 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fc445f1b-08e2-4dca-b4fc-97a7621c80ea tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:54.845734 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fc445f1b-08e2-4dca-b4fc-97a7621c80ea tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:54.846539 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fc445f1b-08e2-4dca-b4fc-97a7621c80ea tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:54.846982 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-fc445f1b-08e2-4dca-b4fc-97a7621c80ea tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:54.985207 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-fc445f1b-08e2-4dca-b4fc-97a7621c80ea tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:54.993341 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-fc445f1b-08e2-4dca-b4fc-97a7621c80ea tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1314 microversion: 2.1 time: 0.158519 Aug 03 12:19:54.993922 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 452/939] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:54 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:56.016534 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-317f3620-5cee-4fc8-8ff7-b206cfb1bf31 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:56.017150 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-317f3620-5cee-4fc8-8ff7-b206cfb1bf31 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:56.019727 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:56.025720 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-317f3620-5cee-4fc8-8ff7-b206cfb1bf31 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:56.026170 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-317f3620-5cee-4fc8-8ff7-b206cfb1bf31 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:56.027426 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-317f3620-5cee-4fc8-8ff7-b206cfb1bf31 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:56.028213 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-317f3620-5cee-4fc8-8ff7-b206cfb1bf31 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:56.167808 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-317f3620-5cee-4fc8-8ff7-b206cfb1bf31 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:56.175352 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-317f3620-5cee-4fc8-8ff7-b206cfb1bf31 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1314 microversion: 2.1 time: 0.163286 Aug 03 12:19:56.175927 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 488/940] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:56 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:56.415371 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-8e7034b9-ef35-40ea-914f-5fa8af316e9f req-93fcc148-8400-4995-83e5-20b0f5d727e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47a2e45-a37e-48ba-9702-8f0847c04af6", "name": "network-vif-plugged", "status": "completed", "tag": "94c97318-e92c-4f53-83e1-3f7430bb194d"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:19:56.422250 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:56.423011 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=6 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:19:56.432460 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-8e7034b9-ef35-40ea-914f-5fa8af316e9f req-93fcc148-8400-4995-83e5-20b0f5d727e5 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:56.433190 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-8e7034b9-ef35-40ea-914f-5fa8af316e9f req-93fcc148-8400-4995-83e5-20b0f5d727e5 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:56.446427 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-8e7034b9-ef35-40ea-914f-5fa8af316e9f req-93fcc148-8400-4995-83e5-20b0f5d727e5 service nova] Creating event network-vif-plugged:94c97318-e92c-4f53-83e1-3f7430bb194d for instance a47a2e45-a37e-48ba-9702-8f0847c04af6 on hv-cinder-83602 Aug 03 12:19:56.457892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-8e7034b9-ef35-40ea-914f-5fa8af316e9f req-93fcc148-8400-4995-83e5-20b0f5d727e5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046860 Aug 03 12:19:56.459675 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 453/941] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:19:56.519651 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1322589581", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452"}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:19:56.577782 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] validate_networks() for None {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:19:56.869474 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:19:56.869892 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:19:56.870395 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:19:56.870835 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:19:56.871245 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:19:56.880006 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:56.880451 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:56.881241 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:56.881667 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:56.898788 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Getting quotas for project 2584328cecd045829ee502063fcf9e21. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:19:56.902772 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Getting quotas for user 8e1ae81db46c46cfa80ddcd32ed57237 and project 2584328cecd045829ee502063fcf9e21. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:19:56.913689 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:19:56.915985 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:19:56.963584 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-fe8425d5-a7ff-4ca9-a5d6-2ad799daa3c0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.447756 Aug 03 12:19:56.964234 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 489/942] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:19:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:19:56.975638 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4ce5a4f6-8bf7-4cb0-93f6-7ceaf83d8fcc tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:56.976345 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-4ce5a4f6-8bf7-4cb0-93f6-7ceaf83d8fcc tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:57.033228 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-4ce5a4f6-8bf7-4cb0-93f6-7ceaf83d8fcc tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:57.040671 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-4ce5a4f6-8bf7-4cb0-93f6-7ceaf83d8fcc tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1215 microversion: 2.1 time: 0.069225 Aug 03 12:19:57.041405 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 454/943] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:56 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:57.196588 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e9fb54f8-75ac-41eb-a3a9-37fb79effe7b tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:57.197196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e9fb54f8-75ac-41eb-a3a9-37fb79effe7b tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:57.211163 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e9fb54f8-75ac-41eb-a3a9-37fb79effe7b tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:57.211614 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e9fb54f8-75ac-41eb-a3a9-37fb79effe7b tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:57.212378 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e9fb54f8-75ac-41eb-a3a9-37fb79effe7b tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:57.212807 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e9fb54f8-75ac-41eb-a3a9-37fb79effe7b tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:57.352768 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e9fb54f8-75ac-41eb-a3a9-37fb79effe7b tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:57.361134 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e9fb54f8-75ac-41eb-a3a9-37fb79effe7b tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1314 microversion: 2.1 time: 0.168359 Aug 03 12:19:57.361733 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 490/944] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:57 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:58.061577 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-46a703c9-44f0-4fdd-9c96-78371d84f515 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:58.062194 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-46a703c9-44f0-4fdd-9c96-78371d84f515 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:58.069415 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46a703c9-44f0-4fdd-9c96-78371d84f515 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:58.069872 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46a703c9-44f0-4fdd-9c96-78371d84f515 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:58.071187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46a703c9-44f0-4fdd-9c96-78371d84f515 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:58.071628 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-46a703c9-44f0-4fdd-9c96-78371d84f515 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:58.131832 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-46a703c9-44f0-4fdd-9c96-78371d84f515 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:58.139957 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-46a703c9-44f0-4fdd-9c96-78371d84f515 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1267 microversion: 2.1 time: 0.082345 Aug 03 12:19:58.140533 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 455/945] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:58 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:58.381945 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-21718c59-bb93-4c0b-97a0-9baba19e7c8a tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:58.383854 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-21718c59-bb93-4c0b-97a0-9baba19e7c8a tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:58.391689 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21718c59-bb93-4c0b-97a0-9baba19e7c8a tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:58.392387 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21718c59-bb93-4c0b-97a0-9baba19e7c8a tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:58.393166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21718c59-bb93-4c0b-97a0-9baba19e7c8a tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:58.393957 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-21718c59-bb93-4c0b-97a0-9baba19e7c8a tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:58.531013 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-21718c59-bb93-4c0b-97a0-9baba19e7c8a tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:58.538874 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-21718c59-bb93-4c0b-97a0-9baba19e7c8a tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1498 microversion: 2.1 time: 0.160807 Aug 03 12:19:58.541975 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 491/946] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:58 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:58.975589 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e63302b1-3e6d-43ed-8b11-179c119d6dc6 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:58.976098 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e63302b1-3e6d-43ed-8b11-179c119d6dc6 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:58.983126 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e63302b1-3e6d-43ed-8b11-179c119d6dc6 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:58.983572 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e63302b1-3e6d-43ed-8b11-179c119d6dc6 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:58.984365 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e63302b1-3e6d-43ed-8b11-179c119d6dc6 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:58.984805 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e63302b1-3e6d-43ed-8b11-179c119d6dc6 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:59.009408 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e63302b1-3e6d-43ed-8b11-179c119d6dc6 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Going to try to terminate instance {{(pid=117911) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:19:59.090747 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e63302b1-3e6d-43ed-8b11-179c119d6dc6 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 204 len: 0 microversion: 2.1 time: 0.118562 Aug 03 12:19:59.091489 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 456/947] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:19:58 2022] DELETE /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:19:59.099853 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-042da4c3-e1fa-4d93-be36-25fe63e3b7c3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:59.100663 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-042da4c3-e1fa-4d93-be36-25fe63e3b7c3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:59.109567 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-042da4c3-e1fa-4d93-be36-25fe63e3b7c3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:59.110023 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-042da4c3-e1fa-4d93-be36-25fe63e3b7c3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:59.111016 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-042da4c3-e1fa-4d93-be36-25fe63e3b7c3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:59.111452 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-042da4c3-e1fa-4d93-be36-25fe63e3b7c3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:59.163246 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3a68bf06-a7de-4a84-9034-09b5023d0661 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:19:59.163945 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-3a68bf06-a7de-4a84-9034-09b5023d0661 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:19:59.182850 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3a68bf06-a7de-4a84-9034-09b5023d0661 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:59.183458 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3a68bf06-a7de-4a84-9034-09b5023d0661 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:59.184347 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3a68bf06-a7de-4a84-9034-09b5023d0661 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:19:59.185188 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3a68bf06-a7de-4a84-9034-09b5023d0661 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:19:59.280840 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-042da4c3-e1fa-4d93-be36-25fe63e3b7c3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:59.288795 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-042da4c3-e1fa-4d93-be36-25fe63e3b7c3 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1504 microversion: 2.1 time: 0.192649 Aug 03 12:19:59.290075 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 492/948] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:59 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:19:59.589945 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-3a68bf06-a7de-4a84-9034-09b5023d0661 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:19:59.597589 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-3a68bf06-a7de-4a84-9034-09b5023d0661 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1315 microversion: 2.1 time: 0.438647 Aug 03 12:19:59.598155 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 457/949] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:19:59 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:20:00.312522 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0ec5f54d-1722-4897-9c71-016636a1ed0c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:00.313878 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0ec5f54d-1722-4897-9c71-016636a1ed0c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:00.321882 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0ec5f54d-1722-4897-9c71-016636a1ed0c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:00.322420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0ec5f54d-1722-4897-9c71-016636a1ed0c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:00.323316 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0ec5f54d-1722-4897-9c71-016636a1ed0c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:00.323968 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0ec5f54d-1722-4897-9c71-016636a1ed0c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:00.563233 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0ec5f54d-1722-4897-9c71-016636a1ed0c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:00.570857 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0ec5f54d-1722-4897-9c71-016636a1ed0c tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1504 microversion: 2.1 time: 0.262586 Aug 03 12:20:00.571550 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 493/950] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:00 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:00.618046 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-78df02e6-0c8a-4b60-9de6-7b99b161db54 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:00.621063 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-78df02e6-0c8a-4b60-9de6-7b99b161db54 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:00.630190 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-78df02e6-0c8a-4b60-9de6-7b99b161db54 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:00.630734 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-78df02e6-0c8a-4b60-9de6-7b99b161db54 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:00.631875 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-78df02e6-0c8a-4b60-9de6-7b99b161db54 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:00.632314 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-78df02e6-0c8a-4b60-9de6-7b99b161db54 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:00.636720 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:00.933277 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-78df02e6-0c8a-4b60-9de6-7b99b161db54 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:00.941456 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-78df02e6-0c8a-4b60-9de6-7b99b161db54 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1315 microversion: 2.1 time: 0.327430 Aug 03 12:20:00.942036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 458/951] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:00 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:01.058201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-0699bc54-c1a8-4b50-aff3-bc299060a77a req-2fd2f29d-6000-4299-8128-c66f07750c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246c526c-7439-46c8-85fd-6fb5c79f583d", "tag": "df910bfe-9ea8-4435-ac5a-185c9db846bb"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:20:01.075720 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-0699bc54-c1a8-4b50-aff3-bc299060a77a req-2fd2f29d-6000-4299-8128-c66f07750c9d service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:01.076287 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-0699bc54-c1a8-4b50-aff3-bc299060a77a req-2fd2f29d-6000-4299-8128-c66f07750c9d service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:01.089557 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-0699bc54-c1a8-4b50-aff3-bc299060a77a req-2fd2f29d-6000-4299-8128-c66f07750c9d service nova] Creating event network-changed:df910bfe-9ea8-4435-ac5a-185c9db846bb for instance 246c526c-7439-46c8-85fd-6fb5c79f583d on hv-cinder-83602 Aug 03 12:20:01.096349 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-0699bc54-c1a8-4b50-aff3-bc299060a77a req-2fd2f29d-6000-4299-8128-c66f07750c9d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041755 Aug 03 12:20:01.097623 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 494/952] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:20:01.593002 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-8d2cb7a5-b4ac-4c8a-905a-e966f55cf641 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:01.593986 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-8d2cb7a5-b4ac-4c8a-905a-e966f55cf641 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:01.600331 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8d2cb7a5-b4ac-4c8a-905a-e966f55cf641 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:01.601079 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8d2cb7a5-b4ac-4c8a-905a-e966f55cf641 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:01.602798 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8d2cb7a5-b4ac-4c8a-905a-e966f55cf641 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:01.603489 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-8d2cb7a5-b4ac-4c8a-905a-e966f55cf641 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:01.687810 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-8d2cb7a5-b4ac-4c8a-905a-e966f55cf641 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:01.697172 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-8d2cb7a5-b4ac-4c8a-905a-e966f55cf641 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1299 microversion: 2.1 time: 0.108310 Aug 03 12:20:01.697760 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 459/953] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:01 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:01.964885 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ef4ff8b1-90e8-4ade-b5bb-f79cd3cfb5dc tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:01.965714 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ef4ff8b1-90e8-4ade-b5bb-f79cd3cfb5dc tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:01.972019 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ef4ff8b1-90e8-4ade-b5bb-f79cd3cfb5dc tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:01.972572 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ef4ff8b1-90e8-4ade-b5bb-f79cd3cfb5dc tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:01.973345 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ef4ff8b1-90e8-4ade-b5bb-f79cd3cfb5dc tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:01.973857 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ef4ff8b1-90e8-4ade-b5bb-f79cd3cfb5dc tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:02.103260 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ef4ff8b1-90e8-4ade-b5bb-f79cd3cfb5dc tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:02.110673 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ef4ff8b1-90e8-4ade-b5bb-f79cd3cfb5dc tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1315 microversion: 2.1 time: 0.151884 Aug 03 12:20:02.111991 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 495/954] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:01 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:02.717274 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-497c1ddb-48ae-44c5-8d21-6eef1f67a858 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:02.717900 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-497c1ddb-48ae-44c5-8d21-6eef1f67a858 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:02.724550 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-497c1ddb-48ae-44c5-8d21-6eef1f67a858 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:02.725007 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-497c1ddb-48ae-44c5-8d21-6eef1f67a858 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:02.725785 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-497c1ddb-48ae-44c5-8d21-6eef1f67a858 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:02.726232 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-497c1ddb-48ae-44c5-8d21-6eef1f67a858 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:02.758741 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-497c1ddb-48ae-44c5-8d21-6eef1f67a858 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:02.759192 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-497c1ddb-48ae-44c5-8d21-6eef1f67a858 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:02.759649 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-497c1ddb-48ae-44c5-8d21-6eef1f67a858 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lazy-loading 'fault' on Instance uuid a47a2e45-a37e-48ba-9702-8f0847c04af6 {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:20:02.800655 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-497c1ddb-48ae-44c5-8d21-6eef1f67a858 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dfc8cbb23024495934b76d07b281996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20296a9e3969428f9d487f021f06e524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:02.808611 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-497c1ddb-48ae-44c5-8d21-6eef1f67a858 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 200 len: 1304 microversion: 2.1 time: 0.095328 Aug 03 12:20:02.809192 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 460/955] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:02 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:03.131394 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0ec7c725-6e1a-486c-9125-64ddb0c8d7e0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:03.132014 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0ec7c725-6e1a-486c-9125-64ddb0c8d7e0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:03.138673 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0ec7c725-6e1a-486c-9125-64ddb0c8d7e0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:03.138914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-e0fb61a1-4d12-4a44-8681-3aa891f7ecfe req-bb14fe3f-45b3-483d-be83-50be62a7ac91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a47a2e45-a37e-48ba-9702-8f0847c04af6", "name": "network-vif-deleted", "tag": "94c97318-e92c-4f53-83e1-3f7430bb194d"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:20:03.139201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0ec7c725-6e1a-486c-9125-64ddb0c8d7e0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:03.139981 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0ec7c725-6e1a-486c-9125-64ddb0c8d7e0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:03.140421 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0ec7c725-6e1a-486c-9125-64ddb0c8d7e0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:03.148861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-e0fb61a1-4d12-4a44-8681-3aa891f7ecfe req-bb14fe3f-45b3-483d-be83-50be62a7ac91 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:03.149602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-e0fb61a1-4d12-4a44-8681-3aa891f7ecfe req-bb14fe3f-45b3-483d-be83-50be62a7ac91 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:03.162183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-e0fb61a1-4d12-4a44-8681-3aa891f7ecfe req-bb14fe3f-45b3-483d-be83-50be62a7ac91 service nova] Creating event network-vif-deleted:94c97318-e92c-4f53-83e1-3f7430bb194d for instance a47a2e45-a37e-48ba-9702-8f0847c04af6 on hv-cinder-83602 Aug 03 12:20:03.168070 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-e0fb61a1-4d12-4a44-8681-3aa891f7ecfe req-bb14fe3f-45b3-483d-be83-50be62a7ac91 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033020 Aug 03 12:20:03.168954 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 461/956] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:20:03.273523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0ec7c725-6e1a-486c-9125-64ddb0c8d7e0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:03.280932 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0ec7c725-6e1a-486c-9125-64ddb0c8d7e0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1315 microversion: 2.1 time: 0.153456 Aug 03 12:20:03.281507 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 496/957] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:03 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:03.830635 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5af4e2bb-939d-4eea-8c2a-f04378423854 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:03.831341 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5af4e2bb-939d-4eea-8c2a-f04378423854 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] [instance: a47a2e45-a37e-48ba-9702-8f0847c04af6] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:03.837540 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5af4e2bb-939d-4eea-8c2a-f04378423854 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:03.838748 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5af4e2bb-939d-4eea-8c2a-f04378423854 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:03.839504 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5af4e2bb-939d-4eea-8c2a-f04378423854 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:03.839935 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5af4e2bb-939d-4eea-8c2a-f04378423854 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:03.853036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-5af4e2bb-939d-4eea-8c2a-f04378423854 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] HTTP exception thrown: Instance a47a2e45-a37e-48ba-9702-8f0847c04af6 could not be found. Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5af4e2bb-939d-4eea-8c2a-f04378423854 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Request method failure captured: Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 HTTP/1.1 Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mfOfFjMIGHWSBnV4DLYbmQxyJPv4dbf-7BT8QzFnfTBmU3k9NMwqFkyAWglMf2rr9OHODv4hRx9IBY87vyWKf2ccyifb9-btv_VEZQMJXyfHh4Mjb-rgxIF55xRHjKboLmnD08GG1A110J2D-eLmochbF7g0Y1dlfpR-ze1MTQMesM Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 20296a9e3969428f9d487f021f06e524 Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-VolumesActionsTest-1098657149 Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:20:03.854865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:20:03.856563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_20296a9e3969428f9d487f021f06e524", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/20296a9e3969428f9d487f021f06e524"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20296a9e3969428f9d487f021f06e524"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20296a9e3969428f9d487f021f06e524"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:20:03.856563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-VolumesActionsTest-1098657149 Aug 03 12:20:03.856563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 20296a9e3969428f9d487f021f06e524 Aug 03 12:20:03.856563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-VolumesActionsTest-1098657149 Aug 03 12:20:03.856563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-VolumesActionsTest-1098657149-project Aug 03 12:20:03.856563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:20:03.856563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:20:03.856563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 5dfc8cbb23024495934b76d07b281996 Aug 03 12:20:03.856563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-VolumesActionsTest-1098657149-project Aug 03 12:20:03.856563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:20:03.856563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance a47a2e45-a37e-48ba-9702-8f0847c04af6 could not be found. Aug 03 12:20:03.856563 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': 'a47a2e45-a37e-48ba-9702-8f0847c04af6'} Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a47a2e45-a37e-48ba-9702-8f0847c04af6 could not be found. Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:20:03.857495 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a47a2e45-a37e-48ba-9702-8f0847c04af6 could not be found. Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a47a2e45-a37e-48ba-9702-8f0847c04af6 could not be found. Aug 03 12:20:03.859081 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:20:03.860467 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5af4e2bb-939d-4eea-8c2a-f04378423854 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] Returning 404 to user: Instance a47a2e45-a37e-48ba-9702-8f0847c04af6 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:20:03.860467 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5af4e2bb-939d-4eea-8c2a-f04378423854 tempest-VolumesActionsTest-1098657149 tempest-VolumesActionsTest-1098657149-project] 10.222.0.17 "GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6" status: 404 len: 111 microversion: 2.1 time: 0.030467 Aug 03 12:20:03.860467 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 462/958] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:03 2022] GET /compute/v2.1/servers/a47a2e45-a37e-48ba-9702-8f0847c04af6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:20:04.303433 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8a796688-fd0c-4dc7-8660-1b870968b615 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:04.304935 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8a796688-fd0c-4dc7-8660-1b870968b615 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:04.314136 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8a796688-fd0c-4dc7-8660-1b870968b615 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:04.314635 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8a796688-fd0c-4dc7-8660-1b870968b615 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:04.315420 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8a796688-fd0c-4dc7-8660-1b870968b615 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:04.315861 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8a796688-fd0c-4dc7-8660-1b870968b615 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:04.464353 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8a796688-fd0c-4dc7-8660-1b870968b615 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:04.472604 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8a796688-fd0c-4dc7-8660-1b870968b615 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1315 microversion: 2.1 time: 0.173578 Aug 03 12:20:04.473708 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 497/959] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:04 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:05.493830 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e1329714-8a4b-4a90-a432-3f42b4dbb546 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:05.494487 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e1329714-8a4b-4a90-a432-3f42b4dbb546 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:05.501154 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e1329714-8a4b-4a90-a432-3f42b4dbb546 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:05.501660 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e1329714-8a4b-4a90-a432-3f42b4dbb546 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:05.502389 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e1329714-8a4b-4a90-a432-3f42b4dbb546 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:05.502860 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e1329714-8a4b-4a90-a432-3f42b4dbb546 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:05.637571 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-e1329714-8a4b-4a90-a432-3f42b4dbb546 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:05.645447 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e1329714-8a4b-4a90-a432-3f42b4dbb546 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1315 microversion: 2.1 time: 0.155668 Aug 03 12:20:05.646011 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 463/960] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:05 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:06.666944 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-79518cce-d92c-47a3-bf59-ed6b7b1d1475 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:06.667588 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-79518cce-d92c-47a3-bf59-ed6b7b1d1475 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:06.670066 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:06.675422 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-79518cce-d92c-47a3-bf59-ed6b7b1d1475 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:06.675867 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-79518cce-d92c-47a3-bf59-ed6b7b1d1475 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:06.676619 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-79518cce-d92c-47a3-bf59-ed6b7b1d1475 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:06.677050 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-79518cce-d92c-47a3-bf59-ed6b7b1d1475 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:06.681562 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=94 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:06.807632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-79518cce-d92c-47a3-bf59-ed6b7b1d1475 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:06.815094 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-79518cce-d92c-47a3-bf59-ed6b7b1d1475 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1315 microversion: 2.1 time: 0.152639 Aug 03 12:20:06.815661 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 498/961] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:06 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:07.836313 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-feb1384f-f12c-4b15-b191-40c7ad404e40 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:07.836964 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-feb1384f-f12c-4b15-b191-40c7ad404e40 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:07.839991 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:07.840796 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:07.846320 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-feb1384f-f12c-4b15-b191-40c7ad404e40 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:07.846809 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-feb1384f-f12c-4b15-b191-40c7ad404e40 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:07.847585 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-feb1384f-f12c-4b15-b191-40c7ad404e40 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:07.848029 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-feb1384f-f12c-4b15-b191-40c7ad404e40 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:07.980860 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-feb1384f-f12c-4b15-b191-40c7ad404e40 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:07.988364 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-feb1384f-f12c-4b15-b191-40c7ad404e40 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1315 microversion: 2.1 time: 0.156016 Aug 03 12:20:07.989515 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 464/962] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:07 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:08.060338 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-d8c3fd3d-86bf-4261-bdea-8bc8c5b351f0 req-6a0c03d4-0ddb-4c8c-87e5-621b24d09c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246c526c-7439-46c8-85fd-6fb5c79f583d", "name": "network-vif-plugged", "status": "completed", "tag": "df910bfe-9ea8-4435-ac5a-185c9db846bb"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:20:08.065219 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:08.065882 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:08.072355 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-d8c3fd3d-86bf-4261-bdea-8bc8c5b351f0 req-6a0c03d4-0ddb-4c8c-87e5-621b24d09c27 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:08.072802 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-d8c3fd3d-86bf-4261-bdea-8bc8c5b351f0 req-6a0c03d4-0ddb-4c8c-87e5-621b24d09c27 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:08.084120 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-d8c3fd3d-86bf-4261-bdea-8bc8c5b351f0 req-6a0c03d4-0ddb-4c8c-87e5-621b24d09c27 service nova] Creating event network-vif-plugged:df910bfe-9ea8-4435-ac5a-185c9db846bb for instance 246c526c-7439-46c8-85fd-6fb5c79f583d on hv-cinder-83602 Aug 03 12:20:08.089526 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-d8c3fd3d-86bf-4261-bdea-8bc8c5b351f0 req-6a0c03d4-0ddb-4c8c-87e5-621b24d09c27 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032971 Aug 03 12:20:08.090122 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 499/963] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:20:09.009057 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a1b54b31-1b64-4019-8abf-53578d295168 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:09.009677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a1b54b31-1b64-4019-8abf-53578d295168 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:09.017015 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a1b54b31-1b64-4019-8abf-53578d295168 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:09.017494 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a1b54b31-1b64-4019-8abf-53578d295168 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:09.018308 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a1b54b31-1b64-4019-8abf-53578d295168 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:09.018799 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a1b54b31-1b64-4019-8abf-53578d295168 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:09.175728 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a1b54b31-1b64-4019-8abf-53578d295168 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:09.193268 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a1b54b31-1b64-4019-8abf-53578d295168 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1315 microversion: 2.1 time: 0.187508 Aug 03 12:20:09.203016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 465/964] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:09 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:10.226789 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-143a3f86-b302-43c1-a844-e58088c98fff tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:10.228280 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-143a3f86-b302-43c1-a844-e58088c98fff tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:10.234915 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-143a3f86-b302-43c1-a844-e58088c98fff tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:10.235584 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-143a3f86-b302-43c1-a844-e58088c98fff tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:10.236546 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-143a3f86-b302-43c1-a844-e58088c98fff tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:10.238995 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-143a3f86-b302-43c1-a844-e58088c98fff tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:10.409284 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-143a3f86-b302-43c1-a844-e58088c98fff tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:10.418259 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-143a3f86-b302-43c1-a844-e58088c98fff tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1465 microversion: 2.1 time: 0.196075 Aug 03 12:20:10.435731 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 500/965] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:10 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1465 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:20:10.466432 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f4bbaa0a-e3b4-4457-b4ec-a891dc05db68 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:10.467632 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f4bbaa0a-e3b4-4457-b4ec-a891dc05db68 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:10.479569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f4bbaa0a-e3b4-4457-b4ec-a891dc05db68 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:10.480835 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f4bbaa0a-e3b4-4457-b4ec-a891dc05db68 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:10.482592 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f4bbaa0a-e3b4-4457-b4ec-a891dc05db68 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:10.483928 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f4bbaa0a-e3b4-4457-b4ec-a891dc05db68 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:10.521540 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f4bbaa0a-e3b4-4457-b4ec-a891dc05db68 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Going to try to terminate instance {{(pid=117911) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:20:10.618051 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f4bbaa0a-e3b4-4457-b4ec-a891dc05db68 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "DELETE /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 204 len: 0 microversion: 2.1 time: 0.155365 Aug 03 12:20:10.620838 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 466/966] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:20:10 2022] DELETE /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:20:10.629120 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c23ceedd-f3fc-4ace-81d4-a8bb8ba02ccd tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:10.629736 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c23ceedd-f3fc-4ace-81d4-a8bb8ba02ccd tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:10.635980 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c23ceedd-f3fc-4ace-81d4-a8bb8ba02ccd tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:10.636676 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c23ceedd-f3fc-4ace-81d4-a8bb8ba02ccd tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:10.637625 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c23ceedd-f3fc-4ace-81d4-a8bb8ba02ccd tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:10.638233 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c23ceedd-f3fc-4ace-81d4-a8bb8ba02ccd tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:10.822221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c23ceedd-f3fc-4ace-81d4-a8bb8ba02ccd tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:10.831565 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c23ceedd-f3fc-4ace-81d4-a8bb8ba02ccd tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1471 microversion: 2.1 time: 0.206232 Aug 03 12:20:10.832525 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 501/967] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:10 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:20:11.853732 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1cfd3483-1388-4953-be83-d832ed265ab0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:11.854502 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1cfd3483-1388-4953-be83-d832ed265ab0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:11.861362 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1cfd3483-1388-4953-be83-d832ed265ab0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:11.861820 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1cfd3483-1388-4953-be83-d832ed265ab0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:11.862642 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1cfd3483-1388-4953-be83-d832ed265ab0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:11.863086 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1cfd3483-1388-4953-be83-d832ed265ab0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:12.013747 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1cfd3483-1388-4953-be83-d832ed265ab0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:12.023645 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1cfd3483-1388-4953-be83-d832ed265ab0 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1471 microversion: 2.1 time: 0.173342 Aug 03 12:20:12.023645 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 467/968] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:11 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:20:12.867436 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-e6a99b66-2a6d-4881-be5c-54d1c2066fe2 req-777abe61-a30e-46ea-a4c4-0b7e902b1b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246c526c-7439-46c8-85fd-6fb5c79f583d", "name": "network-vif-deleted", "tag": "df910bfe-9ea8-4435-ac5a-185c9db846bb"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:20:12.887057 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-e6a99b66-2a6d-4881-be5c-54d1c2066fe2 req-777abe61-a30e-46ea-a4c4-0b7e902b1b09 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:12.887790 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-e6a99b66-2a6d-4881-be5c-54d1c2066fe2 req-777abe61-a30e-46ea-a4c4-0b7e902b1b09 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:12.911149 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-e6a99b66-2a6d-4881-be5c-54d1c2066fe2 req-777abe61-a30e-46ea-a4c4-0b7e902b1b09 service nova] Creating event network-vif-deleted:df910bfe-9ea8-4435-ac5a-185c9db846bb for instance 246c526c-7439-46c8-85fd-6fb5c79f583d on hv-cinder-83602 Aug 03 12:20:12.923039 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-e6a99b66-2a6d-4881-be5c-54d1c2066fe2 req-777abe61-a30e-46ea-a4c4-0b7e902b1b09 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059887 Aug 03 12:20:12.923838 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 502/969] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:20:13.060212 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-87deca5e-18bd-4480-bdbe-c25cbac7687c tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:13.061791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-87deca5e-18bd-4480-bdbe-c25cbac7687c tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:13.069189 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87deca5e-18bd-4480-bdbe-c25cbac7687c tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:13.069991 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87deca5e-18bd-4480-bdbe-c25cbac7687c tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:13.071714 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87deca5e-18bd-4480-bdbe-c25cbac7687c tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:13.072295 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87deca5e-18bd-4480-bdbe-c25cbac7687c tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:13.112664 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87deca5e-18bd-4480-bdbe-c25cbac7687c tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:13.113390 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-87deca5e-18bd-4480-bdbe-c25cbac7687c tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:13.113848 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-87deca5e-18bd-4480-bdbe-c25cbac7687c tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lazy-loading 'fault' on Instance uuid 246c526c-7439-46c8-85fd-6fb5c79f583d {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:20:13.161417 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-87deca5e-18bd-4480-bdbe-c25cbac7687c tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1ae81db46c46cfa80ddcd32ed57237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2584328cecd045829ee502063fcf9e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:13.170592 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-87deca5e-18bd-4480-bdbe-c25cbac7687c tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 200 len: 1305 microversion: 2.1 time: 0.115982 Aug 03 12:20:13.171756 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 468/970] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:13 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 1305 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:14.194265 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-61ff362c-da99-4f9c-bded-1dac4bb0da70 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:14.195013 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-61ff362c-da99-4f9c-bded-1dac4bb0da70 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] [instance: 246c526c-7439-46c8-85fd-6fb5c79f583d] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:14.201971 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61ff362c-da99-4f9c-bded-1dac4bb0da70 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:14.202587 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61ff362c-da99-4f9c-bded-1dac4bb0da70 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:14.203979 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61ff362c-da99-4f9c-bded-1dac4bb0da70 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:14.204431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61ff362c-da99-4f9c-bded-1dac4bb0da70 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:14.223798 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-61ff362c-da99-4f9c-bded-1dac4bb0da70 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] HTTP exception thrown: Instance 246c526c-7439-46c8-85fd-6fb5c79f583d could not be found. Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-61ff362c-da99-4f9c-bded-1dac4bb0da70 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Request method failure captured: Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d HTTP/1.1 Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mfqzL8zmu3Emw4x2fk6hJRnMy4UuvpVCBmygAqX6nK4_Z1edjK12xQkgtNftoSgQfbXrD0W6u9xeF02MHV3ngeroqOPJ901R-1bNvQIkPc9Z5cbSio8Kr54MdoDTGeLv4idR-a57VPw8UkHVXOPpyWbFapmv0X1T1s1BT3FGoVyDfM Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 2584328cecd045829ee502063fcf9e21 Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesNegativeTest-1240004603 Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:20:14.225510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:20:14.227196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2584328cecd045829ee502063fcf9e21", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2584328cecd045829ee502063fcf9e21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2584328cecd045829ee502063fcf9e21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2584328cecd045829ee502063fcf9e21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:20:14.227196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesNegativeTest-1240004603 Aug 03 12:20:14.227196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 2584328cecd045829ee502063fcf9e21 Aug 03 12:20:14.227196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesNegativeTest-1240004603 Aug 03 12:20:14.227196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesNegativeTest-1240004603-project Aug 03 12:20:14.227196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:20:14.227196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:20:14.227196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 8e1ae81db46c46cfa80ddcd32ed57237 Aug 03 12:20:14.227196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesNegativeTest-1240004603-project Aug 03 12:20:14.227196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:20:14.227196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance 246c526c-7439-46c8-85fd-6fb5c79f583d could not be found. Aug 03 12:20:14.227196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': '246c526c-7439-46c8-85fd-6fb5c79f583d'} Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 246c526c-7439-46c8-85fd-6fb5c79f583d could not be found. Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:20:14.228166 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 246c526c-7439-46c8-85fd-6fb5c79f583d could not be found. Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 246c526c-7439-46c8-85fd-6fb5c79f583d could not be found. Aug 03 12:20:14.230258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:20:14.231476 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-61ff362c-da99-4f9c-bded-1dac4bb0da70 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] Returning 404 to user: Instance 246c526c-7439-46c8-85fd-6fb5c79f583d could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:20:14.231476 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-61ff362c-da99-4f9c-bded-1dac4bb0da70 tempest-VolumesNegativeTest-1240004603 tempest-VolumesNegativeTest-1240004603-project] 10.222.0.17 "GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d" status: 404 len: 111 microversion: 2.1 time: 0.037688 Aug 03 12:20:14.231476 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 503/971] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:14 2022] GET /compute/v2.1/servers/246c526c-7439-46c8-85fd-6fb5c79f583d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 12:20:22.907043 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1679939062", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "networks": [{"uuid": "eef5de74-bc70-40ca-ba3a-c09dec5e31aa"}]}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:20:22.970399 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.network.neutron [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] validate_networks() for [('eef5de74-bc70-40ca-ba3a-c09dec5e31aa', None, None, None, None, None)] {{(pid=117911) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:20:23.169551 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:23.373281 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Flavor limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:20:23.373920 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Image limits 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:20:23.374602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Flavor pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:20:23.375158 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Image pref 0:0:0 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:20:23.375661 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.virt.hardware [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117911) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:20:23.386922 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:23.387475 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:23.388388 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:23.388903 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:23.418816 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Getting quotas for project c22099d8e85e4430a1c4ad2bb60d61db. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:20:23.423357 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Getting quotas for user 723938a1e3494a3cac89fdb466daa23f and project c22099d8e85e4430a1c4ad2bb60d61db. Resources: {'instances', 'ram', 'cores'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:20:23.434787 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Going to run 1 instances... {{(pid=117911) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:20:23.437349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117911) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:20:23.486876 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f4230f76-7922-42ef-a6c9-18c223312a59 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586756 Aug 03 12:20:23.487530 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 469/972] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:20:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:20:23.499281 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-313ae9dc-52ef-45e6-b483-ac1c7a79005d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:23.499893 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-313ae9dc-52ef-45e6-b483-ac1c7a79005d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:23.563655 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-313ae9dc-52ef-45e6-b483-ac1c7a79005d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:23.571138 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-313ae9dc-52ef-45e6-b483-ac1c7a79005d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 200 len: 1219 microversion: 2.1 time: 0.076471 Aug 03 12:20:23.571794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 504/973] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:23 2022] GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:20:24.594065 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3f24de2d-03fd-4249-9fc3-9e0163c0da8c tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:24.594549 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-3f24de2d-03fd-4249-9fc3-9e0163c0da8c tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:24.601207 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3f24de2d-03fd-4249-9fc3-9e0163c0da8c tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:24.601462 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3f24de2d-03fd-4249-9fc3-9e0163c0da8c tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:24.603380 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3f24de2d-03fd-4249-9fc3-9e0163c0da8c tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:24.603380 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3f24de2d-03fd-4249-9fc3-9e0163c0da8c tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:24.674026 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-3f24de2d-03fd-4249-9fc3-9e0163c0da8c tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:24.682513 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-3f24de2d-03fd-4249-9fc3-9e0163c0da8c tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 200 len: 1277 microversion: 2.1 time: 0.092857 Aug 03 12:20:24.683191 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 470/974] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:24 2022] GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:25.704004 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f80f2fe0-106a-4998-aff6-72f5757e38bc tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:25.704892 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f80f2fe0-106a-4998-aff6-72f5757e38bc tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:25.707298 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=23 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:25.716200 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f80f2fe0-106a-4998-aff6-72f5757e38bc tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:25.716915 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f80f2fe0-106a-4998-aff6-72f5757e38bc tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:25.717685 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f80f2fe0-106a-4998-aff6-72f5757e38bc tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:25.718718 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f80f2fe0-106a-4998-aff6-72f5757e38bc tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:25.752316 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-e871ea78-8ae2-4da0-a42c-0e93452c0b92 req-e3d0494a-c038-43cf-8e7a-5193de37c85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f608b881-0882-413f-99f1-41b029f9d3f0", "tag": "2d4482bd-ea80-462f-a956-c485d1ab0435"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:20:25.780779 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-e871ea78-8ae2-4da0-a42c-0e93452c0b92 req-e3d0494a-c038-43cf-8e7a-5193de37c85f service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:25.781308 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-e871ea78-8ae2-4da0-a42c-0e93452c0b92 req-e3d0494a-c038-43cf-8e7a-5193de37c85f service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:25.794014 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-e871ea78-8ae2-4da0-a42c-0e93452c0b92 req-e3d0494a-c038-43cf-8e7a-5193de37c85f service nova] Creating event network-changed:2d4482bd-ea80-462f-a956-c485d1ab0435 for instance f608b881-0882-413f-99f1-41b029f9d3f0 on hv-cinder-83602 Aug 03 12:20:25.799635 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-e871ea78-8ae2-4da0-a42c-0e93452c0b92 req-e3d0494a-c038-43cf-8e7a-5193de37c85f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055748 Aug 03 12:20:25.800650 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 471/975] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:20:25.868944 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f80f2fe0-106a-4998-aff6-72f5757e38bc tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:25.879590 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f80f2fe0-106a-4998-aff6-72f5757e38bc tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 200 len: 1319 microversion: 2.1 time: 0.177223 Aug 03 12:20:25.879590 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 505/976] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:25 2022] GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:26.899606 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ff8e6bbc-33ee-40aa-aab3-df729f873e2f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:26.900324 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-ff8e6bbc-33ee-40aa-aab3-df729f873e2f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:26.907848 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ff8e6bbc-33ee-40aa-aab3-df729f873e2f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:26.908292 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ff8e6bbc-33ee-40aa-aab3-df729f873e2f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:26.909113 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ff8e6bbc-33ee-40aa-aab3-df729f873e2f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:26.909743 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-ff8e6bbc-33ee-40aa-aab3-df729f873e2f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:27.415498 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-ff8e6bbc-33ee-40aa-aab3-df729f873e2f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:27.424055 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ff8e6bbc-33ee-40aa-aab3-df729f873e2f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 200 len: 1319 microversion: 2.1 time: 0.530473 Aug 03 12:20:27.424641 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 472/977] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:26 2022] GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:28.444588 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4b6bc56e-0894-4480-bb8f-7fe92bc37db9 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:28.445202 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4b6bc56e-0894-4480-bb8f-7fe92bc37db9 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:28.452261 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b6bc56e-0894-4480-bb8f-7fe92bc37db9 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:28.452704 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b6bc56e-0894-4480-bb8f-7fe92bc37db9 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:28.453460 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b6bc56e-0894-4480-bb8f-7fe92bc37db9 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:28.453888 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4b6bc56e-0894-4480-bb8f-7fe92bc37db9 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:28.583858 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4b6bc56e-0894-4480-bb8f-7fe92bc37db9 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:28.591510 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4b6bc56e-0894-4480-bb8f-7fe92bc37db9 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 200 len: 1319 microversion: 2.1 time: 0.150805 Aug 03 12:20:28.592077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 506/978] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:28 2022] GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:29.612077 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-66d2cc4b-2aa7-4d1c-bad6-7eb320442cc1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:29.612693 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-66d2cc4b-2aa7-4d1c-bad6-7eb320442cc1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:29.619807 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-66d2cc4b-2aa7-4d1c-bad6-7eb320442cc1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:29.620257 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-66d2cc4b-2aa7-4d1c-bad6-7eb320442cc1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:29.621021 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-66d2cc4b-2aa7-4d1c-bad6-7eb320442cc1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:29.621460 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-66d2cc4b-2aa7-4d1c-bad6-7eb320442cc1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:29.755851 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-66d2cc4b-2aa7-4d1c-bad6-7eb320442cc1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:29.764108 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-66d2cc4b-2aa7-4d1c-bad6-7eb320442cc1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 200 len: 1319 microversion: 2.1 time: 0.156277 Aug 03 12:20:29.765044 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 473/979] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:29 2022] GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:30.190237 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-0b03f976-886b-4b6a-b29f-42971673afb0 req-e8c12451-9803-4636-8446-5ef24c005d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f608b881-0882-413f-99f1-41b029f9d3f0", "name": "network-vif-plugged", "status": "completed", "tag": "2d4482bd-ea80-462f-a956-c485d1ab0435"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:20:30.200395 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-0b03f976-886b-4b6a-b29f-42971673afb0 req-e8c12451-9803-4636-8446-5ef24c005d70 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:30.200843 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-0b03f976-886b-4b6a-b29f-42971673afb0 req-e8c12451-9803-4636-8446-5ef24c005d70 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:30.212135 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-0b03f976-886b-4b6a-b29f-42971673afb0 req-e8c12451-9803-4636-8446-5ef24c005d70 service nova] Creating event network-vif-plugged:2d4482bd-ea80-462f-a956-c485d1ab0435 for instance f608b881-0882-413f-99f1-41b029f9d3f0 on hv-cinder-83602 Aug 03 12:20:30.217347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-0b03f976-886b-4b6a-b29f-42971673afb0 req-e8c12451-9803-4636-8446-5ef24c005d70 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030724 Aug 03 12:20:30.218212 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 507/980] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:20:30.785257 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7ec19883-a68a-4373-ab2a-6711c87bb1df tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:30.785941 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7ec19883-a68a-4373-ab2a-6711c87bb1df tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:30.794117 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7ec19883-a68a-4373-ab2a-6711c87bb1df tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:30.794661 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7ec19883-a68a-4373-ab2a-6711c87bb1df tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:30.795608 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7ec19883-a68a-4373-ab2a-6711c87bb1df tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:30.796190 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7ec19883-a68a-4373-ab2a-6711c87bb1df tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:30.927396 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7ec19883-a68a-4373-ab2a-6711c87bb1df tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:30.934786 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7ec19883-a68a-4373-ab2a-6711c87bb1df tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 200 len: 1319 microversion: 2.1 time: 0.153790 Aug 03 12:20:30.935351 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 474/981] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:30 2022] GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:31.956933 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f8086711-316c-4ed4-b45a-5681c2fee84d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:20:31.957668 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f8086711-316c-4ed4-b45a-5681c2fee84d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:31.964366 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8086711-316c-4ed4-b45a-5681c2fee84d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:31.964838 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8086711-316c-4ed4-b45a-5681c2fee84d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:31.965600 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8086711-316c-4ed4-b45a-5681c2fee84d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:31.966038 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f8086711-316c-4ed4-b45a-5681c2fee84d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:32.102882 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-f8086711-316c-4ed4-b45a-5681c2fee84d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:20:32.110303 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f8086711-316c-4ed4-b45a-5681c2fee84d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 200 len: 1508 microversion: 2.1 time: 0.157703 Aug 03 12:20:32.110906 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 508/982] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:20:31 2022] GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:20:46.236797 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c8e2eaa0-474d-448e-8939-b9bdd84c7755 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dfd6a09-becc-4c24-b34c-8ce3e1d1a2af", "device": "/dev/sdb"}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:20:46.239829 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-c8e2eaa0-474d-448e-8939-b9bdd84c7755 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:20:46.242749 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:46.243431 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=6 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:46.244213 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:46.245018 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=28 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:20:46.251979 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c8e2eaa0-474d-448e-8939-b9bdd84c7755 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:46.252438 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c8e2eaa0-474d-448e-8939-b9bdd84c7755 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:46.253232 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c8e2eaa0-474d-448e-8939-b9bdd84c7755 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:20:46.253666 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c8e2eaa0-474d-448e-8939-b9bdd84c7755 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:20:46.505410 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c8e2eaa0-474d-448e-8939-b9bdd84c7755 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "POST /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272502 Aug 03 12:20:46.506558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 475/983] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:20:46 2022] POST /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:21:02.763822 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-99062d49-125c-4748-b8e9-0e11970fca53 req-92170c27-82d7-4be9-8af1-b77b4b50a930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c08ce8fa-c489-489c-9764-f7ddf318ea36", "tag": "624df27a-2568-4e4e-92e7-202eb93b895e"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:21:02.767609 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-f6a6e842-98b9-4130-a0e4-236e27fa5c37 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:02.768180 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f6a6e842-98b9-4130-a0e4-236e27fa5c37 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:02.776854 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:02.779947 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:02.786142 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=23 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:02.786667 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:02.787187 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=20 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:02.790261 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f6a6e842-98b9-4130-a0e4-236e27fa5c37 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:02.790806 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f6a6e842-98b9-4130-a0e4-236e27fa5c37 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:02.791700 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f6a6e842-98b9-4130-a0e4-236e27fa5c37 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:02.792110 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-f6a6e842-98b9-4130-a0e4-236e27fa5c37 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:02.794675 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-99062d49-125c-4748-b8e9-0e11970fca53 req-92170c27-82d7-4be9-8af1-b77b4b50a930 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:02.795155 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-99062d49-125c-4748-b8e9-0e11970fca53 req-92170c27-82d7-4be9-8af1-b77b4b50a930 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:02.808807 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-99062d49-125c-4748-b8e9-0e11970fca53 req-92170c27-82d7-4be9-8af1-b77b4b50a930 service nova] Creating event network-changed:624df27a-2568-4e4e-92e7-202eb93b895e for instance c08ce8fa-c489-489c-9764-f7ddf318ea36 on hv-cinder-83602 Aug 03 12:21:02.814908 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-99062d49-125c-4748-b8e9-0e11970fca53 req-92170c27-82d7-4be9-8af1-b77b4b50a930 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054976 Aug 03 12:21:02.815505 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 476/984] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:21:02.825522 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-f6a6e842-98b9-4130-a0e4-236e27fa5c37 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:21:02.917199 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-f6a6e842-98b9-4130-a0e4-236e27fa5c37 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 204 len: 0 microversion: 2.1 time: 0.159825 Aug 03 12:21:02.917710 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 509/985] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:21:02 2022] DELETE /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:21:02.927108 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2da2892e-45de-4b08-ace2-bdde4e642137 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:02.927969 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2da2892e-45de-4b08-ace2-bdde4e642137 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:02.934891 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2da2892e-45de-4b08-ace2-bdde4e642137 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:02.935350 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2da2892e-45de-4b08-ace2-bdde4e642137 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:02.936806 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2da2892e-45de-4b08-ace2-bdde4e642137 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:02.937284 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2da2892e-45de-4b08-ace2-bdde4e642137 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:03.321946 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2da2892e-45de-4b08-ace2-bdde4e642137 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:03.329874 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2da2892e-45de-4b08-ace2-bdde4e642137 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1579 microversion: 2.1 time: 0.407504 Aug 03 12:21:03.330473 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 477/986] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:02 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1579 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:04.351138 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9b297fe6-e870-4ac2-8dff-31665d900290 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:04.351828 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9b297fe6-e870-4ac2-8dff-31665d900290 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:04.358804 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9b297fe6-e870-4ac2-8dff-31665d900290 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:04.359252 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9b297fe6-e870-4ac2-8dff-31665d900290 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:04.360004 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9b297fe6-e870-4ac2-8dff-31665d900290 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:04.360431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9b297fe6-e870-4ac2-8dff-31665d900290 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:04.702939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9b297fe6-e870-4ac2-8dff-31665d900290 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:04.710403 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9b297fe6-e870-4ac2-8dff-31665d900290 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1579 microversion: 2.1 time: 0.363526 Aug 03 12:21:04.710981 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 510/987] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:04 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1579 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:05.731989 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2d2f4c47-b27e-4aee-b1db-197956510f3e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:05.732602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2d2f4c47-b27e-4aee-b1db-197956510f3e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:05.739631 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2d2f4c47-b27e-4aee-b1db-197956510f3e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:05.740083 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2d2f4c47-b27e-4aee-b1db-197956510f3e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:05.740901 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2d2f4c47-b27e-4aee-b1db-197956510f3e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:05.741281 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2d2f4c47-b27e-4aee-b1db-197956510f3e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:05.905905 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2d2f4c47-b27e-4aee-b1db-197956510f3e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:05.914017 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2d2f4c47-b27e-4aee-b1db-197956510f3e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1579 microversion: 2.1 time: 0.185868 Aug 03 12:21:05.914699 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 478/988] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:05 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1579 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:06.937458 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c7847040-9520-4e51-8ff7-17a2615bcd8b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:06.938162 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c7847040-9520-4e51-8ff7-17a2615bcd8b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:06.944632 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7847040-9520-4e51-8ff7-17a2615bcd8b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:06.945069 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7847040-9520-4e51-8ff7-17a2615bcd8b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:06.945817 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7847040-9520-4e51-8ff7-17a2615bcd8b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:06.946240 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7847040-9520-4e51-8ff7-17a2615bcd8b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:07.090319 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c7847040-9520-4e51-8ff7-17a2615bcd8b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:07.098084 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c7847040-9520-4e51-8ff7-17a2615bcd8b tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 200 len: 1579 microversion: 2.1 time: 0.165078 Aug 03 12:21:07.098689 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 511/989] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:06 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:07.357468 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-43215424-829e-430b-b1b7-87f2ff39eced req-16f3212e-f4a2-4dd4-aef7-f3379ae21191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08ce8fa-c489-489c-9764-f7ddf318ea36", "name": "network-vif-deleted", "tag": "624df27a-2568-4e4e-92e7-202eb93b895e"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:21:07.368163 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-43215424-829e-430b-b1b7-87f2ff39eced req-16f3212e-f4a2-4dd4-aef7-f3379ae21191 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:07.368696 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-43215424-829e-430b-b1b7-87f2ff39eced req-16f3212e-f4a2-4dd4-aef7-f3379ae21191 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:07.380668 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-43215424-829e-430b-b1b7-87f2ff39eced req-16f3212e-f4a2-4dd4-aef7-f3379ae21191 service nova] Creating event network-vif-deleted:624df27a-2568-4e4e-92e7-202eb93b895e for instance c08ce8fa-c489-489c-9764-f7ddf318ea36 on hv-cinder-83602 Aug 03 12:21:07.385684 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-43215424-829e-430b-b1b7-87f2ff39eced req-16f3212e-f4a2-4dd4-aef7-f3379ae21191 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031837 Aug 03 12:21:07.386402 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 479/990] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:21:08.120962 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fcdbaf42-b0b9-49a6-b523-7f0b768950f2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:08.121684 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fcdbaf42-b0b9-49a6-b523-7f0b768950f2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: c08ce8fa-c489-489c-9764-f7ddf318ea36] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:08.128758 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fcdbaf42-b0b9-49a6-b523-7f0b768950f2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:08.129215 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fcdbaf42-b0b9-49a6-b523-7f0b768950f2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:08.129986 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fcdbaf42-b0b9-49a6-b523-7f0b768950f2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:08.130423 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fcdbaf42-b0b9-49a6-b523-7f0b768950f2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:08.144167 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-fcdbaf42-b0b9-49a6-b523-7f0b768950f2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] HTTP exception thrown: Instance c08ce8fa-c489-489c-9764-f7ddf318ea36 could not be found. Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fcdbaf42-b0b9-49a6-b523-7f0b768950f2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Request method failure captured: Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 HTTP/1.1 Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mZbPbLQhVad68K-n9zaoY5chdtsAMQEyuzcD-d8_vNECRY1Yew1oxlQ0mmLvBmzmAEwX-nEIm95seUV4qJ-IWKx-20BNQvNgZjRI6E_jXNyucpaFd16g9X_GxrFH6AEN7ipWQcmhSL3HvvK_338KhIq1WOPco2Y-gDl_bVLDbD43ew Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 1a4c09dba5b24ef5b37b730b259d3790 Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-TestVolumeBootPattern-635734442 Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:21:08.146201 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:21:08.148011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a4c09dba5b24ef5b37b730b259d3790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:21:08.148011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-TestVolumeBootPattern-635734442 Aug 03 12:21:08.148011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 1a4c09dba5b24ef5b37b730b259d3790 Aug 03 12:21:08.148011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-TestVolumeBootPattern-635734442 Aug 03 12:21:08.148011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-TestVolumeBootPattern-635734442-project Aug 03 12:21:08.148011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:21:08.148011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:21:08.148011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 5cf524f6288040219c0492d3a794e830 Aug 03 12:21:08.148011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-TestVolumeBootPattern-635734442-project Aug 03 12:21:08.148011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:21:08.148011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance c08ce8fa-c489-489c-9764-f7ddf318ea36 could not be found. Aug 03 12:21:08.148011 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'c08ce8fa-c489-489c-9764-f7ddf318ea36'} Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c08ce8fa-c489-489c-9764-f7ddf318ea36 could not be found. Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:21:08.148930 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c08ce8fa-c489-489c-9764-f7ddf318ea36 could not be found. Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c08ce8fa-c489-489c-9764-f7ddf318ea36 could not be found. Aug 03 12:21:08.150523 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:08.151665 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fcdbaf42-b0b9-49a6-b523-7f0b768950f2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Returning 404 to user: Instance c08ce8fa-c489-489c-9764-f7ddf318ea36 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:21:08.151665 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-fcdbaf42-b0b9-49a6-b523-7f0b768950f2 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36" status: 404 len: 111 microversion: 2.1 time: 0.030890 Aug 03 12:21:08.151665 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 512/991] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:08 2022] GET /compute/v2.1/servers/c08ce8fa-c489-489c-9764-f7ddf318ea36 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:21:09.214258 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-69385f82-581b-4de5-bc45-851f5356a21d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:09.214870 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-69385f82-581b-4de5-bc45-851f5356a21d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:09.221561 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-69385f82-581b-4de5-bc45-851f5356a21d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:09.222004 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-69385f82-581b-4de5-bc45-851f5356a21d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:09.222803 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-69385f82-581b-4de5-bc45-851f5356a21d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:09.223241 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-69385f82-581b-4de5-bc45-851f5356a21d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:09.306205 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-69385f82-581b-4de5-bc45-851f5356a21d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lazy-loading 'services' on Instance uuid f608b881-0882-413f-99f1-41b029f9d3f0 {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:21:09.380053 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-69385f82-581b-4de5-bc45-851f5356a21d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0/os-volume_attachments/4dfd6a09-becc-4c24-b34c-8ce3e1d1a2af" status: 202 len: 0 microversion: 2.1 time: 0.170352 Aug 03 12:21:09.380730 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 480/992] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 3 12:21:09 2022] DELETE /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0/os-volume_attachments/4dfd6a09-becc-4c24-b34c-8ce3e1d1a2af => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:21:10.442424 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 12:21:10.443337 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Wed Aug 3 12:21:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 12:21:10.510195 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5b590330-440b-4134-9f18-c0309c08acf4 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:10.510730 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5b590330-440b-4134-9f18-c0309c08acf4 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:10.517518 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b590330-440b-4134-9f18-c0309c08acf4 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:10.517963 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b590330-440b-4134-9f18-c0309c08acf4 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:10.518750 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b590330-440b-4134-9f18-c0309c08acf4 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:10.519184 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b590330-440b-4134-9f18-c0309c08acf4 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:10.544160 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5b590330-440b-4134-9f18-c0309c08acf4 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:21:10.622389 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5b590330-440b-4134-9f18-c0309c08acf4 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 204 len: 0 microversion: 2.1 time: 0.115751 Aug 03 12:21:10.623169 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 513/993] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:21:10 2022] DELETE /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:21:10.632449 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d901e02c-8930-4b0d-b4b1-2f30e976c1f1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:10.633158 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d901e02c-8930-4b0d-b4b1-2f30e976c1f1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:10.639569 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d901e02c-8930-4b0d-b4b1-2f30e976c1f1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:10.640114 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d901e02c-8930-4b0d-b4b1-2f30e976c1f1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:10.640942 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d901e02c-8930-4b0d-b4b1-2f30e976c1f1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:10.641475 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d901e02c-8930-4b0d-b4b1-2f30e976c1f1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:10.794797 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d901e02c-8930-4b0d-b4b1-2f30e976c1f1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:10.803076 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d901e02c-8930-4b0d-b4b1-2f30e976c1f1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 200 len: 1514 microversion: 2.1 time: 0.175260 Aug 03 12:21:10.803711 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 481/994] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:10 2022] GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:11.236747 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ce5d71af-83be-4fc8-b888-25e3d6a6c48e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:11.237455 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ce5d71af-83be-4fc8-b888-25e3d6a6c48e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:11.238769 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-7acc615c-3912-47c2-9395-0e55156590bc req-2349be58-fc33-4c3c-b60a-afcf4f2663eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df1f8fb-2c96-4ef7-98ce-8df409fa3054", "tag": "8da85e18-cee2-4903-a631-2f87bee7cafb"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:21:11.244972 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ce5d71af-83be-4fc8-b888-25e3d6a6c48e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:11.245536 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ce5d71af-83be-4fc8-b888-25e3d6a6c48e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:11.246408 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ce5d71af-83be-4fc8-b888-25e3d6a6c48e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:11.247104 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ce5d71af-83be-4fc8-b888-25e3d6a6c48e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:11.253541 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-7acc615c-3912-47c2-9395-0e55156590bc req-2349be58-fc33-4c3c-b60a-afcf4f2663eb service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:11.253991 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-7acc615c-3912-47c2-9395-0e55156590bc req-2349be58-fc33-4c3c-b60a-afcf4f2663eb service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:11.265755 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-7acc615c-3912-47c2-9395-0e55156590bc req-2349be58-fc33-4c3c-b60a-afcf4f2663eb service nova] Creating event network-changed:8da85e18-cee2-4903-a631-2f87bee7cafb for instance 4df1f8fb-2c96-4ef7-98ce-8df409fa3054 on hv-cinder-83602 Aug 03 12:21:11.271618 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-7acc615c-3912-47c2-9395-0e55156590bc req-2349be58-fc33-4c3c-b60a-afcf4f2663eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036379 Aug 03 12:21:11.272460 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 482/995] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:21:11.277904 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ce5d71af-83be-4fc8-b888-25e3d6a6c48e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:21:11.360067 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ce5d71af-83be-4fc8-b888-25e3d6a6c48e tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 204 len: 0 microversion: 2.1 time: 0.127925 Aug 03 12:21:11.360648 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 514/996] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:21:11 2022] DELETE /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:21:11.369539 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-32cc1cf0-c854-47d7-baf7-6ab1251bd3f9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:11.370270 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-32cc1cf0-c854-47d7-baf7-6ab1251bd3f9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:11.376571 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32cc1cf0-c854-47d7-baf7-6ab1251bd3f9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:11.377018 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32cc1cf0-c854-47d7-baf7-6ab1251bd3f9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:11.377773 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32cc1cf0-c854-47d7-baf7-6ab1251bd3f9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:11.378206 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-32cc1cf0-c854-47d7-baf7-6ab1251bd3f9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:11.515125 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-32cc1cf0-c854-47d7-baf7-6ab1251bd3f9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:11.523505 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-32cc1cf0-c854-47d7-baf7-6ab1251bd3f9 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1580 microversion: 2.1 time: 0.158169 Aug 03 12:21:11.524183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 483/997] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:11 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1580 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:11.825130 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-ec13d2e8-498c-49a0-a526-d1dca211741d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:11.825828 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-ec13d2e8-498c-49a0-a526-d1dca211741d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:11.832772 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec13d2e8-498c-49a0-a526-d1dca211741d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:11.833223 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec13d2e8-498c-49a0-a526-d1dca211741d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:11.833982 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec13d2e8-498c-49a0-a526-d1dca211741d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:11.834412 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-ec13d2e8-498c-49a0-a526-d1dca211741d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:11.971946 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-ec13d2e8-498c-49a0-a526-d1dca211741d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:11.980200 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-ec13d2e8-498c-49a0-a526-d1dca211741d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 200 len: 1514 microversion: 2.1 time: 0.159233 Aug 03 12:21:11.980754 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 515/998] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:11 2022] GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:12.546221 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-dba0164c-1b57-422a-b31d-0ad8f8f8cf90 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:12.547780 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-dba0164c-1b57-422a-b31d-0ad8f8f8cf90 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:12.554294 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dba0164c-1b57-422a-b31d-0ad8f8f8cf90 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:12.554776 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dba0164c-1b57-422a-b31d-0ad8f8f8cf90 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:12.555533 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dba0164c-1b57-422a-b31d-0ad8f8f8cf90 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:12.555970 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-dba0164c-1b57-422a-b31d-0ad8f8f8cf90 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:12.688666 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-dba0164c-1b57-422a-b31d-0ad8f8f8cf90 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:12.696215 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-dba0164c-1b57-422a-b31d-0ad8f8f8cf90 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1580 microversion: 2.1 time: 0.154841 Aug 03 12:21:12.696782 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 484/999] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:12 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1580 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:13.004579 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-54e49977-3bcd-4d57-823e-e5421ca08c18 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:13.005196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-54e49977-3bcd-4d57-823e-e5421ca08c18 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:13.011886 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-54e49977-3bcd-4d57-823e-e5421ca08c18 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:13.012342 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-54e49977-3bcd-4d57-823e-e5421ca08c18 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:13.013106 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-54e49977-3bcd-4d57-823e-e5421ca08c18 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:13.013548 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-54e49977-3bcd-4d57-823e-e5421ca08c18 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:13.143500 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-54e49977-3bcd-4d57-823e-e5421ca08c18 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:13.151309 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-54e49977-3bcd-4d57-823e-e5421ca08c18 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 200 len: 1514 microversion: 2.1 time: 0.150656 Aug 03 12:21:13.151905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 516/1000] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:12 2022] GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:13.717821 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-da1b10eb-c192-4615-8716-750691c4b373 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:13.718456 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-da1b10eb-c192-4615-8716-750691c4b373 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:13.726326 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-da1b10eb-c192-4615-8716-750691c4b373 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:13.726812 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-da1b10eb-c192-4615-8716-750691c4b373 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:13.727789 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-da1b10eb-c192-4615-8716-750691c4b373 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:13.728235 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-da1b10eb-c192-4615-8716-750691c4b373 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:14.046526 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-da1b10eb-c192-4615-8716-750691c4b373 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf524f6288040219c0492d3a794e830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a4c09dba5b24ef5b37b730b259d3790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:14.057765 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-da1b10eb-c192-4615-8716-750691c4b373 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 200 len: 1580 microversion: 2.1 time: 0.344284 Aug 03 12:21:14.058690 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 485/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:13 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 1580 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:21:14.086087 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-50ef09ff-5255-4c4b-ad09-cc92aa16d145 req-8b1e0522-fbe0-4f74-85b9-2994d190325f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df1f8fb-2c96-4ef7-98ce-8df409fa3054", "name": "network-vif-deleted", "tag": "8da85e18-cee2-4903-a631-2f87bee7cafb"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:21:14.097723 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-50ef09ff-5255-4c4b-ad09-cc92aa16d145 req-8b1e0522-fbe0-4f74-85b9-2994d190325f service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:14.098222 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-50ef09ff-5255-4c4b-ad09-cc92aa16d145 req-8b1e0522-fbe0-4f74-85b9-2994d190325f service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:14.112099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-50ef09ff-5255-4c4b-ad09-cc92aa16d145 req-8b1e0522-fbe0-4f74-85b9-2994d190325f service nova] Creating event network-vif-deleted:8da85e18-cee2-4903-a631-2f87bee7cafb for instance 4df1f8fb-2c96-4ef7-98ce-8df409fa3054 on hv-cinder-83602 Aug 03 12:21:14.116882 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-50ef09ff-5255-4c4b-ad09-cc92aa16d145 req-8b1e0522-fbe0-4f74-85b9-2994d190325f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034462 Aug 03 12:21:14.117487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 517/1002] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:21:14.174816 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5d2d1830-48c4-4f8d-b481-2cd1860b0019 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:14.175448 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5d2d1830-48c4-4f8d-b481-2cd1860b0019 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:14.181558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5d2d1830-48c4-4f8d-b481-2cd1860b0019 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:14.182245 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5d2d1830-48c4-4f8d-b481-2cd1860b0019 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:14.183093 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5d2d1830-48c4-4f8d-b481-2cd1860b0019 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:14.183538 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5d2d1830-48c4-4f8d-b481-2cd1860b0019 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:14.274865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5d2d1830-48c4-4f8d-b481-2cd1860b0019 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:14.284388 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5d2d1830-48c4-4f8d-b481-2cd1860b0019 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 200 len: 1472 microversion: 2.1 time: 0.115031 Aug 03 12:21:14.285630 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 486/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:14 2022] GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 1472 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:14.290406 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-3ce91d38-2d92-4114-b8b5-94548e32f3e3 req-99a7dbc7-9242-4124-8e36-c8f21d8a1143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f608b881-0882-413f-99f1-41b029f9d3f0", "name": "network-vif-deleted", "tag": "2d4482bd-ea80-462f-a956-c485d1ab0435"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:21:14.301643 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-3ce91d38-2d92-4114-b8b5-94548e32f3e3 req-99a7dbc7-9242-4124-8e36-c8f21d8a1143 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:14.302091 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-3ce91d38-2d92-4114-b8b5-94548e32f3e3 req-99a7dbc7-9242-4124-8e36-c8f21d8a1143 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:14.313828 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-3ce91d38-2d92-4114-b8b5-94548e32f3e3 req-99a7dbc7-9242-4124-8e36-c8f21d8a1143 service nova] Creating event network-vif-deleted:2d4482bd-ea80-462f-a956-c485d1ab0435 for instance f608b881-0882-413f-99f1-41b029f9d3f0 on hv-cinder-83602 Aug 03 12:21:14.318695 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-3ce91d38-2d92-4114-b8b5-94548e32f3e3 req-99a7dbc7-9242-4124-8e36-c8f21d8a1143 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034968 Aug 03 12:21:14.319291 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 518/1004] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:21:15.033523 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 12:21:15.034120 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Wed Aug 3 12:21:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 12:21:15.079755 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3fb917e3-ce31-49aa-8ebf-421b51e8790a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:15.080284 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-3fb917e3-ce31-49aa-8ebf-421b51e8790a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 4df1f8fb-2c96-4ef7-98ce-8df409fa3054] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:15.086879 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3fb917e3-ce31-49aa-8ebf-421b51e8790a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:15.087337 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3fb917e3-ce31-49aa-8ebf-421b51e8790a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:15.088117 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3fb917e3-ce31-49aa-8ebf-421b51e8790a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:15.088558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-3fb917e3-ce31-49aa-8ebf-421b51e8790a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:15.102303 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-3fb917e3-ce31-49aa-8ebf-421b51e8790a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] HTTP exception thrown: Instance 4df1f8fb-2c96-4ef7-98ce-8df409fa3054 could not be found. Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3fb917e3-ce31-49aa-8ebf-421b51e8790a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Request method failure captured: Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 HTTP/1.1 Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mZbPbLQhVad68K-n9zaoY5chdtsAMQEyuzcD-d8_vNECRY1Yew1oxlQ0mmLvBmzmAEwX-nEIm95seUV4qJ-IWKx-20BNQvNgZjRI6E_jXNyucpaFd16g9X_GxrFH6AEN7ipWQcmhSL3HvvK_338KhIq1WOPco2Y-gDl_bVLDbD43ew Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 1a4c09dba5b24ef5b37b730b259d3790 Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-TestVolumeBootPattern-635734442 Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:21:15.103999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:21:15.105602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a4c09dba5b24ef5b37b730b259d3790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:21:15.105602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-TestVolumeBootPattern-635734442 Aug 03 12:21:15.105602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 1a4c09dba5b24ef5b37b730b259d3790 Aug 03 12:21:15.105602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-TestVolumeBootPattern-635734442 Aug 03 12:21:15.105602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-TestVolumeBootPattern-635734442-project Aug 03 12:21:15.105602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:21:15.105602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:21:15.105602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 5cf524f6288040219c0492d3a794e830 Aug 03 12:21:15.105602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-TestVolumeBootPattern-635734442-project Aug 03 12:21:15.105602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:21:15.105602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance 4df1f8fb-2c96-4ef7-98ce-8df409fa3054 could not be found. Aug 03 12:21:15.105602 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': '4df1f8fb-2c96-4ef7-98ce-8df409fa3054'} Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df1f8fb-2c96-4ef7-98ce-8df409fa3054 could not be found. Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:21:15.106840 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df1f8fb-2c96-4ef7-98ce-8df409fa3054 could not be found. Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df1f8fb-2c96-4ef7-98ce-8df409fa3054 could not be found. Aug 03 12:21:15.108868 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.110287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-3fb917e3-ce31-49aa-8ebf-421b51e8790a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Returning 404 to user: Instance 4df1f8fb-2c96-4ef7-98ce-8df409fa3054 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:21:15.110287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-3fb917e3-ce31-49aa-8ebf-421b51e8790a tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054" status: 404 len: 111 microversion: 2.1 time: 0.029759 Aug 03 12:21:15.110287 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 487/1005] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:15 2022] GET /compute/v2.1/servers/4df1f8fb-2c96-4ef7-98ce-8df409fa3054 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:21:15.308151 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d412fd61-a216-446c-9785-e17af29df17d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:15.308863 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-d412fd61-a216-446c-9785-e17af29df17d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: f608b881-0882-413f-99f1-41b029f9d3f0] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:15.315245 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d412fd61-a216-446c-9785-e17af29df17d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:15.315532 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d412fd61-a216-446c-9785-e17af29df17d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:15.316311 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d412fd61-a216-446c-9785-e17af29df17d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:15.316755 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-d412fd61-a216-446c-9785-e17af29df17d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:15.330720 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-d412fd61-a216-446c-9785-e17af29df17d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] HTTP exception thrown: Instance f608b881-0882-413f-99f1-41b029f9d3f0 could not be found. Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d412fd61-a216-446c-9785-e17af29df17d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Request method failure captured: Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 HTTP/1.1 Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mgF88v7huxcYUoVmogn3kA7LupcsGE_P-fDAFVkHstgx6G7oWzpK8dM-3xcMNajB_w6wKS9hBbtmGxDsu0STwlOHgS-Gd7dgApj34cp00z-fQcr32AtbcmnaZeQWeO1m9HhrwNMnhaOayAc-nTTysQR7rBodgGxUzlYk9n_AnkAisE Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: c22099d8e85e4430a1c4ad2bb60d61db Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1909136965 Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:21:15.332308 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:21:15.333928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22099d8e85e4430a1c4ad2bb60d61db", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22099d8e85e4430a1c4ad2bb60d61db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22099d8e85e4430a1c4ad2bb60d61db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22099d8e85e4430a1c4ad2bb60d61db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:21:15.333928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesSnapshotTestJSON-1909136965 Aug 03 12:21:15.333928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: c22099d8e85e4430a1c4ad2bb60d61db Aug 03 12:21:15.333928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1909136965 Aug 03 12:21:15.333928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesSnapshotTestJSON-1909136965-project Aug 03 12:21:15.333928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:21:15.333928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:21:15.333928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 723938a1e3494a3cac89fdb466daa23f Aug 03 12:21:15.333928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesSnapshotTestJSON-1909136965-project Aug 03 12:21:15.333928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:21:15.333928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance f608b881-0882-413f-99f1-41b029f9d3f0 could not be found. Aug 03 12:21:15.333928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': 'f608b881-0882-413f-99f1-41b029f9d3f0'} Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f608b881-0882-413f-99f1-41b029f9d3f0 could not be found. Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:21:15.334794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f608b881-0882-413f-99f1-41b029f9d3f0 could not be found. Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f608b881-0882-413f-99f1-41b029f9d3f0 could not be found. Aug 03 12:21:15.336018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.337140 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-d412fd61-a216-446c-9785-e17af29df17d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Returning 404 to user: Instance f608b881-0882-413f-99f1-41b029f9d3f0 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:21:15.337140 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-d412fd61-a216-446c-9785-e17af29df17d tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0" status: 404 len: 111 microversion: 2.1 time: 0.030488 Aug 03 12:21:15.337140 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 519/1006] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:15 2022] GET /compute/v2.1/servers/f608b881-0882-413f-99f1-41b029f9d3f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:21:15.573364 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7567daed-77cc-4444-8dee-f217da96cc07 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:15.573866 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7567daed-77cc-4444-8dee-f217da96cc07 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:15.581376 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7567daed-77cc-4444-8dee-f217da96cc07 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:15.581959 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7567daed-77cc-4444-8dee-f217da96cc07 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:15.583409 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7567daed-77cc-4444-8dee-f217da96cc07 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:15.584094 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7567daed-77cc-4444-8dee-f217da96cc07 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:15.599349 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-7567daed-77cc-4444-8dee-f217da96cc07 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] HTTP exception thrown: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7567daed-77cc-4444-8dee-f217da96cc07 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Request method failure captured: Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: DELETE /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 HTTP/1.1 Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mZbPbLQhVad68K-n9zaoY5chdtsAMQEyuzcD-d8_vNECRY1Yew1oxlQ0mmLvBmzmAEwX-nEIm95seUV4qJ-IWKx-20BNQvNgZjRI6E_jXNyucpaFd16g9X_GxrFH6AEN7ipWQcmhSL3HvvK_338KhIq1WOPco2Y-gDl_bVLDbD43ew Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: 1a4c09dba5b24ef5b37b730b259d3790 Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-TestVolumeBootPattern-635734442 Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:21:15.600918 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:21:15.602555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a4c09dba5b24ef5b37b730b259d3790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:21:15.602555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-TestVolumeBootPattern-635734442 Aug 03 12:21:15.602555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: 1a4c09dba5b24ef5b37b730b259d3790 Aug 03 12:21:15.602555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-TestVolumeBootPattern-635734442 Aug 03 12:21:15.602555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-TestVolumeBootPattern-635734442-project Aug 03 12:21:15.602555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:21:15.602555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:21:15.602555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 5cf524f6288040219c0492d3a794e830 Aug 03 12:21:15.602555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-TestVolumeBootPattern-635734442-project Aug 03 12:21:15.602555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:21:15.602555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:21:15.602555 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': '692c1c3e-e3b3-4d9a-ac59-e82611208c18'} Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:21:15.603558 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:21:15.604791 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.606128 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7567daed-77cc-4444-8dee-f217da96cc07 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Returning 404 to user: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:21:15.606128 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7567daed-77cc-4444-8dee-f217da96cc07 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "DELETE /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 404 len: 111 microversion: 2.1 time: 0.032849 Aug 03 12:21:15.606128 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 488/1007] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:21:15 2022] DELETE /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:21:15.611187 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2e9f29c5-eea5-46f9-9bd0-b39f66cf0672 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:15.611810 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2e9f29c5-eea5-46f9-9bd0-b39f66cf0672 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] [instance: 692c1c3e-e3b3-4d9a-ac59-e82611208c18] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:15.617971 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2e9f29c5-eea5-46f9-9bd0-b39f66cf0672 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:15.618423 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2e9f29c5-eea5-46f9-9bd0-b39f66cf0672 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:15.619218 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2e9f29c5-eea5-46f9-9bd0-b39f66cf0672 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:15.619660 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2e9f29c5-eea5-46f9-9bd0-b39f66cf0672 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:15.633413 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-2e9f29c5-eea5-46f9-9bd0-b39f66cf0672 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] HTTP exception thrown: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2e9f29c5-eea5-46f9-9bd0-b39f66cf0672 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Request method failure captured: Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 HTTP/1.1 Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mZbPbLQhVad68K-n9zaoY5chdtsAMQEyuzcD-d8_vNECRY1Yew1oxlQ0mmLvBmzmAEwX-nEIm95seUV4qJ-IWKx-20BNQvNgZjRI6E_jXNyucpaFd16g9X_GxrFH6AEN7ipWQcmhSL3HvvK_338KhIq1WOPco2Y-gDl_bVLDbD43ew Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: 1a4c09dba5b24ef5b37b730b259d3790 Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-TestVolumeBootPattern-635734442 Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:21:15.634987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:21:15.636555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a4c09dba5b24ef5b37b730b259d3790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a4c09dba5b24ef5b37b730b259d3790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:21:15.636555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-TestVolumeBootPattern-635734442 Aug 03 12:21:15.636555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: 1a4c09dba5b24ef5b37b730b259d3790 Aug 03 12:21:15.636555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-TestVolumeBootPattern-635734442 Aug 03 12:21:15.636555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-TestVolumeBootPattern-635734442-project Aug 03 12:21:15.636555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:21:15.636555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:21:15.636555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 5cf524f6288040219c0492d3a794e830 Aug 03 12:21:15.636555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-TestVolumeBootPattern-635734442-project Aug 03 12:21:15.636555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:21:15.636555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:21:15.636555 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': '692c1c3e-e3b3-4d9a-ac59-e82611208c18'} Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:21:15.637509 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. Aug 03 12:21:15.639077 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:15.641599 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2e9f29c5-eea5-46f9-9bd0-b39f66cf0672 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Returning 404 to user: Instance 692c1c3e-e3b3-4d9a-ac59-e82611208c18 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:21:15.641599 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2e9f29c5-eea5-46f9-9bd0-b39f66cf0672 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18" status: 404 len: 111 microversion: 2.1 time: 0.029114 Aug 03 12:21:15.641599 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 520/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:15 2022] GET /compute/v2.1/servers/692c1c3e-e3b3-4d9a-ac59-e82611208c18 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:21:19.037490 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-ba66cda9-1cf3-4fd4-861c-157f892646c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] Calling method '.version_select at 0x7f14d6febe50>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:19.064148 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-ba66cda9-1cf3-4fd4-861c-157f892646c0 tempest-TestVolumeBootPattern-635734442 tempest-TestVolumeBootPattern-635734442-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1695578460" status: 202 len: 0 microversion: 2.1 time: 0.030576 Aug 03 12:21:19.064744 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 489/1009] 10.222.0.17 () {58 vars in 1263 bytes} [Wed Aug 3 12:21:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1695578460 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:21:23.197466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-233254868", "imageRef": "0cd1e0a1-c247-4558-b477-cbe3c421258e", "flavorRef": "452", "networks": [{"uuid": "eef5de74-bc70-40ca-ba3a-c09dec5e31aa"}]}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:21:23.250908 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] validate_networks() for [('eef5de74-bc70-40ca-ba3a-c09dec5e31aa', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:21:24.178284 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:21:24.178817 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:21:24.179371 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:21:24.179850 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:21:24.180451 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:21:24.190823 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:24.191408 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:24.192429 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:24.193258 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:24.212178 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Getting quotas for project c22099d8e85e4430a1c4ad2bb60d61db. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:21:24.216225 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Getting quotas for user 723938a1e3494a3cac89fdb466daa23f and project c22099d8e85e4430a1c4ad2bb60d61db. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:21:24.227586 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:21:24.229848 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cd1e0a1-c247-4558-b477-cbe3c421258e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:21:24.276765 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2fd30d8d-97f5-4f56-ae2b-0466fec6bcd3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083093 Aug 03 12:21:24.277699 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 521/1010] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:21:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:21:24.289131 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-61c9f061-20ac-4f9f-933c-0a9445345ebe tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:24.289758 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-61c9f061-20ac-4f9f-933c-0a9445345ebe tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:24.377221 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-61c9f061-20ac-4f9f-933c-0a9445345ebe tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:24.394392 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-61c9f061-20ac-4f9f-933c-0a9445345ebe tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185" status: 200 len: 1218 microversion: 2.1 time: 0.109167 Aug 03 12:21:24.398699 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 490/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:24 2022] GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:25.417991 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-86284d17-84aa-4ba7-a268-db36553d8369 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:25.418701 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-86284d17-84aa-4ba7-a268-db36553d8369 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:25.428651 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-86284d17-84aa-4ba7-a268-db36553d8369 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:25.429113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-86284d17-84aa-4ba7-a268-db36553d8369 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:25.429900 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-86284d17-84aa-4ba7-a268-db36553d8369 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:25.430341 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-86284d17-84aa-4ba7-a268-db36553d8369 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:25.521780 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-86284d17-84aa-4ba7-a268-db36553d8369 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:25.533031 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-86284d17-84aa-4ba7-a268-db36553d8369 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185" status: 200 len: 1276 microversion: 2.1 time: 0.119462 Aug 03 12:21:25.547058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 522/1012] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:25 2022] GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 => generated 1276 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:26.554940 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5107ca1b-f2c3-440d-b27b-9c1c344ce550 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:26.555704 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5107ca1b-f2c3-440d-b27b-9c1c344ce550 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:26.558044 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:26.563556 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5107ca1b-f2c3-440d-b27b-9c1c344ce550 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:26.564068 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5107ca1b-f2c3-440d-b27b-9c1c344ce550 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:26.564958 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5107ca1b-f2c3-440d-b27b-9c1c344ce550 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:26.565310 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5107ca1b-f2c3-440d-b27b-9c1c344ce550 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:26.768656 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5107ca1b-f2c3-440d-b27b-9c1c344ce550 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:26.777086 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5107ca1b-f2c3-440d-b27b-9c1c344ce550 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185" status: 200 len: 1318 microversion: 2.1 time: 0.226322 Aug 03 12:21:26.778361 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 491/1013] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:26 2022] GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:27.037536 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-82a3e115-161c-44f2-815d-abd30de0b193 req-2c64bace-1736-46c6-8bbc-d8e32c113ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed032d9-79db-41a7-aa2f-927df9d67185", "tag": "edee6d42-faa8-4569-a1d7-9c6359ef3c9c"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:21:27.058750 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-82a3e115-161c-44f2-815d-abd30de0b193 req-2c64bace-1736-46c6-8bbc-d8e32c113ae0 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:27.066054 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-82a3e115-161c-44f2-815d-abd30de0b193 req-2c64bace-1736-46c6-8bbc-d8e32c113ae0 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:27.087840 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-82a3e115-161c-44f2-815d-abd30de0b193 req-2c64bace-1736-46c6-8bbc-d8e32c113ae0 service nova] Creating event network-changed:edee6d42-faa8-4569-a1d7-9c6359ef3c9c for instance 7ed032d9-79db-41a7-aa2f-927df9d67185 on hv-cinder-83602 Aug 03 12:21:27.093789 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-82a3e115-161c-44f2-815d-abd30de0b193 req-2c64bace-1736-46c6-8bbc-d8e32c113ae0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064876 Aug 03 12:21:27.094974 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 523/1014] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:21:27.798524 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-9574ce87-6681-40af-a4ee-ac7f71a36c1a tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:27.799149 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-9574ce87-6681-40af-a4ee-ac7f71a36c1a tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:27.805810 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9574ce87-6681-40af-a4ee-ac7f71a36c1a tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:27.806283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9574ce87-6681-40af-a4ee-ac7f71a36c1a tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:27.807068 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9574ce87-6681-40af-a4ee-ac7f71a36c1a tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:27.807515 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-9574ce87-6681-40af-a4ee-ac7f71a36c1a tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:27.939841 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-9574ce87-6681-40af-a4ee-ac7f71a36c1a tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:27.947478 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-9574ce87-6681-40af-a4ee-ac7f71a36c1a tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185" status: 200 len: 1318 microversion: 2.1 time: 0.152828 Aug 03 12:21:27.947977 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 492/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:27 2022] GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:28.969757 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b65ee5fa-5a25-418a-8423-1abeb7796ae8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:28.970468 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b65ee5fa-5a25-418a-8423-1abeb7796ae8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:28.976724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b65ee5fa-5a25-418a-8423-1abeb7796ae8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:28.977169 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b65ee5fa-5a25-418a-8423-1abeb7796ae8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:28.977928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b65ee5fa-5a25-418a-8423-1abeb7796ae8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:28.978377 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b65ee5fa-5a25-418a-8423-1abeb7796ae8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:29.108604 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b65ee5fa-5a25-418a-8423-1abeb7796ae8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:29.116091 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b65ee5fa-5a25-418a-8423-1abeb7796ae8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185" status: 200 len: 1318 microversion: 2.1 time: 0.151671 Aug 03 12:21:29.116988 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 524/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:28 2022] GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:21:30.137235 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-d665d74f-1fc6-4aad-9f5b-bc4cdf9e9ba1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:30.138199 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-d665d74f-1fc6-4aad-9f5b-bc4cdf9e9ba1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:30.145244 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d665d74f-1fc6-4aad-9f5b-bc4cdf9e9ba1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:30.145946 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d665d74f-1fc6-4aad-9f5b-bc4cdf9e9ba1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:30.146748 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d665d74f-1fc6-4aad-9f5b-bc4cdf9e9ba1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:30.147219 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-d665d74f-1fc6-4aad-9f5b-bc4cdf9e9ba1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:30.276166 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-d665d74f-1fc6-4aad-9f5b-bc4cdf9e9ba1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:30.283672 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-d665d74f-1fc6-4aad-9f5b-bc4cdf9e9ba1 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185" status: 200 len: 1318 microversion: 2.1 time: 0.150338 Aug 03 12:21:30.284242 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 493/1017] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:30 2022] GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:30.839012 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-92bc8b82-014b-4c3b-a2d1-a912bf59db88 req-41d626d1-39d5-41b7-b14e-48b25c69bc62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed032d9-79db-41a7-aa2f-927df9d67185", "name": "network-vif-plugged", "status": "completed", "tag": "edee6d42-faa8-4569-a1d7-9c6359ef3c9c"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:21:30.852385 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-92bc8b82-014b-4c3b-a2d1-a912bf59db88 req-41d626d1-39d5-41b7-b14e-48b25c69bc62 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:30.853372 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-92bc8b82-014b-4c3b-a2d1-a912bf59db88 req-41d626d1-39d5-41b7-b14e-48b25c69bc62 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:30.859704 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:30.869910 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-92bc8b82-014b-4c3b-a2d1-a912bf59db88 req-41d626d1-39d5-41b7-b14e-48b25c69bc62 service nova] Creating event network-vif-plugged:edee6d42-faa8-4569-a1d7-9c6359ef3c9c for instance 7ed032d9-79db-41a7-aa2f-927df9d67185 on hv-cinder-83602 Aug 03 12:21:30.875378 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-92bc8b82-014b-4c3b-a2d1-a912bf59db88 req-41d626d1-39d5-41b7-b14e-48b25c69bc62 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040275 Aug 03 12:21:30.876347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 525/1018] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:21:31.304976 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a0e3cd47-f753-4016-b5b6-4a71c86b676b tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:31.305503 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a0e3cd47-f753-4016-b5b6-4a71c86b676b tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:31.311996 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a0e3cd47-f753-4016-b5b6-4a71c86b676b tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:31.312434 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a0e3cd47-f753-4016-b5b6-4a71c86b676b tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:31.313183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a0e3cd47-f753-4016-b5b6-4a71c86b676b tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:31.313615 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a0e3cd47-f753-4016-b5b6-4a71c86b676b tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:31.448272 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a0e3cd47-f753-4016-b5b6-4a71c86b676b tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:31.456343 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a0e3cd47-f753-4016-b5b6-4a71c86b676b tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185" status: 200 len: 1318 microversion: 2.1 time: 0.155382 Aug 03 12:21:31.456914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 494/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:31 2022] GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:32.478389 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-1d3f7adb-31e5-42df-b1a9-596096d3bef3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:32.479040 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-1d3f7adb-31e5-42df-b1a9-596096d3bef3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:32.486912 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1d3f7adb-31e5-42df-b1a9-596096d3bef3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:32.487362 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1d3f7adb-31e5-42df-b1a9-596096d3bef3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:32.488118 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1d3f7adb-31e5-42df-b1a9-596096d3bef3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:32.488549 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-1d3f7adb-31e5-42df-b1a9-596096d3bef3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:32.615542 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-1d3f7adb-31e5-42df-b1a9-596096d3bef3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:32.622964 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-1d3f7adb-31e5-42df-b1a9-596096d3bef3 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185" status: 200 len: 1508 microversion: 2.1 time: 0.149710 Aug 03 12:21:32.623532 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 526/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:32 2022] GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:32.643827 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-e0092ee3-8fd2-4d77-b964-62ad106338c8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d2b4f25-1eae-4175-b153-028ae4d31ae2", "device": "/dev/sdb"}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:21:32.646658 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-e0092ee3-8fd2-4d77-b964-62ad106338c8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:32.653120 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e0092ee3-8fd2-4d77-b964-62ad106338c8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:32.653806 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e0092ee3-8fd2-4d77-b964-62ad106338c8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:32.655481 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e0092ee3-8fd2-4d77-b964-62ad106338c8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:32.656040 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-e0092ee3-8fd2-4d77-b964-62ad106338c8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:32.889957 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-e0092ee3-8fd2-4d77-b964-62ad106338c8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "POST /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249243 Aug 03 12:21:32.890591 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 495/1021] 10.222.0.17 () {60 vars in 1323 bytes} [Wed Aug 3 12:21:32 2022] POST /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:21:49.104565 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-203c55c8-9af6-4097-8d2e-bcf76f37290f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:49.105071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-203c55c8-9af6-4097-8d2e-bcf76f37290f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:49.107454 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:49.108113 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:49.109293 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:49.109967 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=6 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:49.116388 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-203c55c8-9af6-4097-8d2e-bcf76f37290f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:49.116861 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-203c55c8-9af6-4097-8d2e-bcf76f37290f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:49.117628 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-203c55c8-9af6-4097-8d2e-bcf76f37290f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:49.118070 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-203c55c8-9af6-4097-8d2e-bcf76f37290f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:49.198947 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-203c55c8-9af6-4097-8d2e-bcf76f37290f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lazy-loading 'services' on Instance uuid 7ed032d9-79db-41a7-aa2f-927df9d67185 {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:21:49.271630 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-203c55c8-9af6-4097-8d2e-bcf76f37290f tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185/os-volume_attachments/5d2b4f25-1eae-4175-b153-028ae4d31ae2" status: 202 len: 0 microversion: 2.1 time: 0.170790 Aug 03 12:21:49.272216 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 527/1022] 10.222.0.17 () {58 vars in 1416 bytes} [Wed Aug 3 12:21:49 2022] DELETE /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185/os-volume_attachments/5d2b4f25-1eae-4175-b153-028ae4d31ae2 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:21:50.386086 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=2 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:50.387115 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:50.387804 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:21:50.392377 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1ec5b0c1-a786-4340-9849-ad21fc586502 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:50.392960 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1ec5b0c1-a786-4340-9849-ad21fc586502 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:50.401318 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1ec5b0c1-a786-4340-9849-ad21fc586502 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:50.401761 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1ec5b0c1-a786-4340-9849-ad21fc586502 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:50.402537 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1ec5b0c1-a786-4340-9849-ad21fc586502 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:50.402971 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1ec5b0c1-a786-4340-9849-ad21fc586502 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:50.428008 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1ec5b0c1-a786-4340-9849-ad21fc586502 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Going to try to terminate instance {{(pid=117911) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:21:50.505122 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1ec5b0c1-a786-4340-9849-ad21fc586502 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185" status: 204 len: 0 microversion: 2.1 time: 0.120187 Aug 03 12:21:50.505732 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 496/1023] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:21:50 2022] DELETE /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:21:50.514987 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-67ec407e-9937-4582-ad5b-30e02561f954 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:50.515688 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-67ec407e-9937-4582-ad5b-30e02561f954 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:50.522550 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-67ec407e-9937-4582-ad5b-30e02561f954 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:50.522905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-67ec407e-9937-4582-ad5b-30e02561f954 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:50.523661 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-67ec407e-9937-4582-ad5b-30e02561f954 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:50.524093 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-67ec407e-9937-4582-ad5b-30e02561f954 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:50.658952 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-67ec407e-9937-4582-ad5b-30e02561f954 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:50.667196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-67ec407e-9937-4582-ad5b-30e02561f954 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185" status: 200 len: 1514 microversion: 2.1 time: 0.156858 Aug 03 12:21:50.667856 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 528/1024] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:50 2022] GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:51.689267 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2ec46b6c-ae4f-4efb-bbfd-95780d9b0939 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:51.689963 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2ec46b6c-ae4f-4efb-bbfd-95780d9b0939 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:51.696493 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2ec46b6c-ae4f-4efb-bbfd-95780d9b0939 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:51.696937 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2ec46b6c-ae4f-4efb-bbfd-95780d9b0939 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:51.697691 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2ec46b6c-ae4f-4efb-bbfd-95780d9b0939 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:51.698121 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2ec46b6c-ae4f-4efb-bbfd-95780d9b0939 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:51.829002 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2ec46b6c-ae4f-4efb-bbfd-95780d9b0939 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:51.836547 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2ec46b6c-ae4f-4efb-bbfd-95780d9b0939 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185" status: 200 len: 1514 microversion: 2.1 time: 0.151572 Aug 03 12:21:51.837109 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 497/1025] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:51 2022] GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:52.670800 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-7afbb560-2146-4257-afe1-c659bbdc1083 req-9cbf93c0-b215-4b6d-8403-c1990859bb64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed032d9-79db-41a7-aa2f-927df9d67185", "name": "network-vif-deleted", "tag": "edee6d42-faa8-4569-a1d7-9c6359ef3c9c"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:21:52.680677 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-7afbb560-2146-4257-afe1-c659bbdc1083 req-9cbf93c0-b215-4b6d-8403-c1990859bb64 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:52.681117 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-7afbb560-2146-4257-afe1-c659bbdc1083 req-9cbf93c0-b215-4b6d-8403-c1990859bb64 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:52.692237 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-7afbb560-2146-4257-afe1-c659bbdc1083 req-9cbf93c0-b215-4b6d-8403-c1990859bb64 service nova] Creating event network-vif-deleted:edee6d42-faa8-4569-a1d7-9c6359ef3c9c for instance 7ed032d9-79db-41a7-aa2f-927df9d67185 on hv-cinder-83602 Aug 03 12:21:52.697022 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-7afbb560-2146-4257-afe1-c659bbdc1083 req-9cbf93c0-b215-4b6d-8403-c1990859bb64 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211436 Aug 03 12:21:52.697603 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 529/1026] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:21:52.857074 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f060f9f5-7c12-4cd4-bee9-815750b5e0e8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:52.857694 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f060f9f5-7c12-4cd4-bee9-815750b5e0e8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:52.864807 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f060f9f5-7c12-4cd4-bee9-815750b5e0e8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:52.865255 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f060f9f5-7c12-4cd4-bee9-815750b5e0e8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:52.866026 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f060f9f5-7c12-4cd4-bee9-815750b5e0e8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:52.866494 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f060f9f5-7c12-4cd4-bee9-815750b5e0e8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:52.899129 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f060f9f5-7c12-4cd4-bee9-815750b5e0e8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:52.899580 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f060f9f5-7c12-4cd4-bee9-815750b5e0e8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:52.900069 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.objects.instance [None req-f060f9f5-7c12-4cd4-bee9-815750b5e0e8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lazy-loading 'fault' on Instance uuid 7ed032d9-79db-41a7-aa2f-927df9d67185 {{(pid=117911) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:21:52.942358 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f060f9f5-7c12-4cd4-bee9-815750b5e0e8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '723938a1e3494a3cac89fdb466daa23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22099d8e85e4430a1c4ad2bb60d61db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:21:52.950705 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f060f9f5-7c12-4cd4-bee9-815750b5e0e8 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185" status: 200 len: 1308 microversion: 2.1 time: 0.097480 Aug 03 12:21:52.951283 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 498/1027] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:52 2022] GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:21:53.973259 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b16fa2a2-f5df-48fa-8880-480ca943d005 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:21:53.973966 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b16fa2a2-f5df-48fa-8880-480ca943d005 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] [instance: 7ed032d9-79db-41a7-aa2f-927df9d67185] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:21:53.980658 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b16fa2a2-f5df-48fa-8880-480ca943d005 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:53.981112 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b16fa2a2-f5df-48fa-8880-480ca943d005 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:53.981876 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b16fa2a2-f5df-48fa-8880-480ca943d005 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:21:53.982323 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b16fa2a2-f5df-48fa-8880-480ca943d005 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:21:53.995351 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.wsgi [None req-b16fa2a2-f5df-48fa-8880-480ca943d005 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] HTTP exception thrown: Instance 7ed032d9-79db-41a7-aa2f-927df9d67185 could not be found. Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b16fa2a2-f5df-48fa-8880-480ca943d005 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Request method failure captured: Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: request: GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 HTTP/1.1 Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept: application/json Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Accept-Encoding: identity Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Connection: close Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Length: 0 Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Content-Type: application/json Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Host: 10.222.0.17 Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Openstack-System-Scope: None Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: User-Agent: python-urllib3/1.26.10 Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Auth-Token: gAAAAABi6mgF88v7huxcYUoVmogn3kA7LupcsGE_P-fDAFVkHstgx6G7oWzpK8dM-3xcMNajB_w6wKS9hBbtmGxDsu0STwlOHgS-Gd7dgApj34cp00z-fQcr32AtbcmnaZeQWeO1m9HhrwNMnhaOayAc-nTTysQR7rBodgGxUzlYk9n_AnkAisE Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Id: None Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Domain-Name: None Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Identity-Status: Confirmed Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Is-Admin-Project: True Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Id: default Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Domain-Name: Default Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Id: c22099d8e85e4430a1c4ad2bb60d61db Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1909136965 Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Role: reader,member Aug 03 12:21:53.997646 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Roles: reader,member Aug 03 12:21:53.999398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c22099d8e85e4430a1c4ad2bb60d61db", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c22099d8e85e4430a1c4ad2bb60d61db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22099d8e85e4430a1c4ad2bb60d61db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c22099d8e85e4430a1c4ad2bb60d61db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:21:53.999398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant: tempest-VolumesSnapshotTestJSON-1909136965 Aug 03 12:21:53.999398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Id: c22099d8e85e4430a1c4ad2bb60d61db Aug 03 12:21:53.999398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1909136965 Aug 03 12:21:53.999398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User: tempest-VolumesSnapshotTestJSON-1909136965-project Aug 03 12:21:53.999398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Id: default Aug 03 12:21:53.999398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Domain-Name: Default Aug 03 12:21:53.999398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Id: 723938a1e3494a3cac89fdb466daa23f Aug 03 12:21:53.999398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: X-User-Name: tempest-VolumesSnapshotTestJSON-1909136965-project Aug 03 12:21:53.999398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: method: > Aug 03 12:21:53.999398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: exception: Instance 7ed032d9-79db-41a7-aa2f-927df9d67185 could not be found. Aug 03 12:21:53.999398 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: action_args: {'id': '7ed032d9-79db-41a7-aa2f-927df9d67185'} Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed032d9-79db-41a7-aa2f-927df9d67185 could not be found. Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:21:54.000356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed032d9-79db-41a7-aa2f-927df9d67185 could not be found. Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed032d9-79db-41a7-aa2f-927df9d67185 could not be found. Aug 03 12:21:54.002901 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR nova.api.openstack.wsgi Aug 03 12:21:54.004298 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b16fa2a2-f5df-48fa-8880-480ca943d005 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] Returning 404 to user: Instance 7ed032d9-79db-41a7-aa2f-927df9d67185 could not be found. {{(pid=117910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:21:54.004298 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b16fa2a2-f5df-48fa-8880-480ca943d005 tempest-VolumesSnapshotTestJSON-1909136965 tempest-VolumesSnapshotTestJSON-1909136965-project] 10.222.0.17 "GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185" status: 404 len: 111 microversion: 2.1 time: 0.031478 Aug 03 12:21:54.004298 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 530/1028] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:21:53 2022] GET /compute/v2.1/servers/7ed032d9-79db-41a7-aa2f-927df9d67185 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:22:26.622213 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:26.622964 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:26.790155 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1ea84531-2f2e-4ee7-8605-70efb7166aac tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Action: 'create', calling method: .version_select at 0x7f14d6cc8160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1765847360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvQCbeR3VKgW/FDeWfv+MK6+T4m8+HY8TM6mjcBTyaGhDch/SvU9FnTLxgZrTaDvM6Xied0JKObXmaepsqtJVtDIKo6S5PyN8P0/fIONPMtGLFXXMllkJW5WlLTLZRbqg=="}} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:22:26.806033 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-1ea84531-2f2e-4ee7-8605-70efb7166aac tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Getting quotas for project b1199da325f44f4a86d9c7f0e3240e39. Resources: {'key_pairs'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:22:26.810329 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.quota [None req-1ea84531-2f2e-4ee7-8605-70efb7166aac tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Getting quotas for user 7bdcd9a30fe4463399960e4a4cc151fd and project b1199da325f44f4a86d9c7f0e3240e39. Resources: {'key_pairs'} {{(pid=117911) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:22:26.836007 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1ea84531-2f2e-4ee7-8605-70efb7166aac tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.218637 Aug 03 12:22:26.836619 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 499/1029] 10.222.0.17 () {60 vars in 1159 bytes} [Wed Aug 3 12:22:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:22:42.033888 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-420791280", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1765847360", "security_groups": [{"name": "tempest-secgroup-smoke-1420654"}], "networks": [{"uuid": "aaf37637-3e5c-4c45-b0ce-e9f2fb78d9d2"}], "block_device_mapping_v2": [{"uuid": "f8f58169-44ed-40b3-b171-70d8d9692189", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:22:42.043995 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=8 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:42.044647 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:42.152753 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.network.neutron [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] validate_networks() for [('aaf37637-3e5c-4c45-b0ce-e9f2fb78d9d2', None, None, None, None, None)] {{(pid=117910) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 12:22:42.621671 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Flavor limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 12:22:42.622099 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Image limits 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 12:22:42.622735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Flavor pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 12:22:42.623191 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Image pref 0:0:0 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 12:22:42.623664 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.virt.hardware [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117910) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 12:22:42.632368 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:42.632812 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:42.633604 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:42.634040 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:42.650490 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Getting quotas for project b1199da325f44f4a86d9c7f0e3240e39. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 12:22:42.654368 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.quota [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Getting quotas for user 7bdcd9a30fe4463399960e4a4cc151fd and project b1199da325f44f4a86d9c7f0e3240e39. Resources: {'instances', 'ram', 'cores'} {{(pid=117910) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 12:22:42.710928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Going to run 1 instances... {{(pid=117910) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 12:22:42.713007 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8f58169-44ed-40b3-b171-70d8d9692189',volume_size=None,volume_type=None)] {{(pid=117910) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 12:22:42.841711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-32cd43b7-f8ae-4707-8751-9675dd06b041 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.811627 Aug 03 12:22:42.842355 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 531/1030] 10.222.0.17 () {60 vars in 1147 bytes} [Wed Aug 3 12:22:42 2022] POST /compute/v2.1/servers => generated 403 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 12:22:42.851109 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=4 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:42.851961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:42.856249 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b066803c-ba7c-4b2b-9ef7-21bf94db65bd tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:42.856865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b066803c-ba7c-4b2b-9ef7-21bf94db65bd tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:42.910419 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b066803c-ba7c-4b2b-9ef7-21bf94db65bd tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:42.918467 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b066803c-ba7c-4b2b-9ef7-21bf94db65bd tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1088 microversion: 2.1 time: 0.069303 Aug 03 12:22:42.919023 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 500/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:42 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:43.939218 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-2880a9dc-3a4e-404e-b625-fcf665f4e088 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:43.939967 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-2880a9dc-3a4e-404e-b625-fcf665f4e088 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:43.995196 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-2880a9dc-3a4e-404e-b625-fcf665f4e088 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:44.002015 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-2880a9dc-3a4e-404e-b625-fcf665f4e088 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1088 microversion: 2.1 time: 0.067302 Aug 03 12:22:44.002588 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 532/1032] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:43 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:45.024701 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-317a46aa-6e52-4b5f-9a44-0b117101aa33 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:45.025552 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-317a46aa-6e52-4b5f-9a44-0b117101aa33 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:45.078831 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-317a46aa-6e52-4b5f-9a44-0b117101aa33 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:45.087946 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-317a46aa-6e52-4b5f-9a44-0b117101aa33 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1088 microversion: 2.1 time: 0.068492 Aug 03 12:22:45.088583 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 501/1033] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:45 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:46.108483 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5a1caaf8-07e8-4696-a5a1-d64d88c92936 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:46.109121 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5a1caaf8-07e8-4696-a5a1-d64d88c92936 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:46.165477 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5a1caaf8-07e8-4696-a5a1-d64d88c92936 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:46.172249 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5a1caaf8-07e8-4696-a5a1-d64d88c92936 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1088 microversion: 2.1 time: 0.067774 Aug 03 12:22:46.172819 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 533/1034] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:46 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:47.191694 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2029d0f8-dd4a-44f6-a037-936c91c5e940 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:47.192300 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2029d0f8-dd4a-44f6-a037-936c91c5e940 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:47.199710 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2029d0f8-dd4a-44f6-a037-936c91c5e940 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:47.200163 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2029d0f8-dd4a-44f6-a037-936c91c5e940 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:47.200966 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2029d0f8-dd4a-44f6-a037-936c91c5e940 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:47.201409 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2029d0f8-dd4a-44f6-a037-936c91c5e940 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:47.261288 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2029d0f8-dd4a-44f6-a037-936c91c5e940 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:47.269208 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2029d0f8-dd4a-44f6-a037-936c91c5e940 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1138 microversion: 2.1 time: 0.081353 Aug 03 12:22:47.269789 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 502/1035] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:47 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:48.290927 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c2e08764-d95a-4b31-a680-a0646c090a50 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:48.291496 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c2e08764-d95a-4b31-a680-a0646c090a50 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:48.298109 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c2e08764-d95a-4b31-a680-a0646c090a50 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:48.298602 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c2e08764-d95a-4b31-a680-a0646c090a50 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:48.299388 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c2e08764-d95a-4b31-a680-a0646c090a50 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:48.299827 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c2e08764-d95a-4b31-a680-a0646c090a50 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:48.363812 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c2e08764-d95a-4b31-a680-a0646c090a50 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:48.372635 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c2e08764-d95a-4b31-a680-a0646c090a50 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1204 microversion: 2.1 time: 0.085828 Aug 03 12:22:48.373428 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 534/1036] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:48 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1204 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:49.287003 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-241c090c-29d8-49ca-b1c3-b6ca9aa1a22d req-94decf4f-1287-4905-af31-9f0b9a50a622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a94bdd5-88da-4ea8-b03d-198e616c13dc", "tag": "83ffe82b-8b33-4a62-a5ab-eb2342a33b9a"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:22:49.300513 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-241c090c-29d8-49ca-b1c3-b6ca9aa1a22d req-94decf4f-1287-4905-af31-9f0b9a50a622 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:49.300951 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-241c090c-29d8-49ca-b1c3-b6ca9aa1a22d req-94decf4f-1287-4905-af31-9f0b9a50a622 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:49.313098 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-241c090c-29d8-49ca-b1c3-b6ca9aa1a22d req-94decf4f-1287-4905-af31-9f0b9a50a622 service nova] Creating event network-changed:83ffe82b-8b33-4a62-a5ab-eb2342a33b9a for instance 2a94bdd5-88da-4ea8-b03d-198e616c13dc on hv-cinder-83602 Aug 03 12:22:49.317948 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-241c090c-29d8-49ca-b1c3-b6ca9aa1a22d req-94decf4f-1287-4905-af31-9f0b9a50a622 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034651 Aug 03 12:22:49.318763 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 503/1037] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:22:49.394724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-cc3f0539-3904-4e0d-bcb9-c7e1ac418fad tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:49.395319 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-cc3f0539-3904-4e0d-bcb9-c7e1ac418fad tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:49.403164 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cc3f0539-3904-4e0d-bcb9-c7e1ac418fad tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:49.403553 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cc3f0539-3904-4e0d-bcb9-c7e1ac418fad tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:49.404320 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cc3f0539-3904-4e0d-bcb9-c7e1ac418fad tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:49.404777 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-cc3f0539-3904-4e0d-bcb9-c7e1ac418fad tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:49.536612 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-cc3f0539-3904-4e0d-bcb9-c7e1ac418fad tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:49.544124 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-cc3f0539-3904-4e0d-bcb9-c7e1ac418fad tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1257 microversion: 2.1 time: 0.153306 Aug 03 12:22:49.544705 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 535/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:49 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:50.566202 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-a20a04be-d6cb-423c-912a-a575de41d5e7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:50.566943 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-a20a04be-d6cb-423c-912a-a575de41d5e7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:50.573187 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a20a04be-d6cb-423c-912a-a575de41d5e7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:50.573639 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a20a04be-d6cb-423c-912a-a575de41d5e7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:50.574455 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a20a04be-d6cb-423c-912a-a575de41d5e7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:50.574903 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-a20a04be-d6cb-423c-912a-a575de41d5e7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:50.728200 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-a20a04be-d6cb-423c-912a-a575de41d5e7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:50.735738 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-a20a04be-d6cb-423c-912a-a575de41d5e7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1257 microversion: 2.1 time: 0.174283 Aug 03 12:22:50.736309 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 504/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:50 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1257 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:51.756269 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-929f2cf4-a18f-4d16-ad2f-7f6551240df2 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:51.756887 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-929f2cf4-a18f-4d16-ad2f-7f6551240df2 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:51.763660 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-929f2cf4-a18f-4d16-ad2f-7f6551240df2 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:51.764028 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-929f2cf4-a18f-4d16-ad2f-7f6551240df2 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:51.764802 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-929f2cf4-a18f-4d16-ad2f-7f6551240df2 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:51.765244 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-929f2cf4-a18f-4d16-ad2f-7f6551240df2 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:51.901932 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-929f2cf4-a18f-4d16-ad2f-7f6551240df2 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:51.910336 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-929f2cf4-a18f-4d16-ad2f-7f6551240df2 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1257 microversion: 2.1 time: 0.158074 Aug 03 12:22:51.910951 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 536/1040] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:51 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:52.931391 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-292e5357-9343-479b-9781-8a1251595204 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:52.932054 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-292e5357-9343-479b-9781-8a1251595204 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:52.938174 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-292e5357-9343-479b-9781-8a1251595204 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:52.938654 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-292e5357-9343-479b-9781-8a1251595204 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:52.939409 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-292e5357-9343-479b-9781-8a1251595204 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:52.939845 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-292e5357-9343-479b-9781-8a1251595204 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:53.073865 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-292e5357-9343-479b-9781-8a1251595204 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:53.081394 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-292e5357-9343-479b-9781-8a1251595204 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1257 microversion: 2.1 time: 0.154046 Aug 03 12:22:53.081997 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 505/1041] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:52 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:54.102771 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0426bdd0-4201-4c4e-9a9a-9b20d21bd989 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:54.103409 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0426bdd0-4201-4c4e-9a9a-9b20d21bd989 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:54.105237 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=2 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:54.110992 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0426bdd0-4201-4c4e-9a9a-9b20d21bd989 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:54.111440 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0426bdd0-4201-4c4e-9a9a-9b20d21bd989 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:54.112275 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0426bdd0-4201-4c4e-9a9a-9b20d21bd989 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:54.112630 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0426bdd0-4201-4c4e-9a9a-9b20d21bd989 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:54.245423 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0426bdd0-4201-4c4e-9a9a-9b20d21bd989 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:54.252939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0426bdd0-4201-4c4e-9a9a-9b20d21bd989 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1257 microversion: 2.1 time: 0.154058 Aug 03 12:22:54.253513 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 537/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:54 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:55.274715 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-4bf8e9fb-d93c-4ec7-b346-afb0b3189f16 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:55.275367 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-4bf8e9fb-d93c-4ec7-b346-afb0b3189f16 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:55.277843 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell0:SELECT=4 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:55.283392 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4bf8e9fb-d93c-4ec7-b346-afb0b3189f16 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:55.283830 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4bf8e9fb-d93c-4ec7-b346-afb0b3189f16 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:55.284597 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4bf8e9fb-d93c-4ec7-b346-afb0b3189f16 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:55.285036 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-4bf8e9fb-d93c-4ec7-b346-afb0b3189f16 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:55.419037 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-4bf8e9fb-d93c-4ec7-b346-afb0b3189f16 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:55.426600 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-4bf8e9fb-d93c-4ec7-b346-afb0b3189f16 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1257 microversion: 2.1 time: 0.156139 Aug 03 12:22:55.427167 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 506/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:55 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:56.448065 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-9a0c3ed7-53f9-49db-b20c-d8dffedc5aee tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:56.448728 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-9a0c3ed7-53f9-49db-b20c-d8dffedc5aee tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:56.450950 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell0:SELECT=10 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:22:56.456221 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a0c3ed7-53f9-49db-b20c-d8dffedc5aee tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:56.456663 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a0c3ed7-53f9-49db-b20c-d8dffedc5aee tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:56.457418 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a0c3ed7-53f9-49db-b20c-d8dffedc5aee tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:56.457844 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-9a0c3ed7-53f9-49db-b20c-d8dffedc5aee tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:56.590002 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-9a0c3ed7-53f9-49db-b20c-d8dffedc5aee tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:56.597518 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-9a0c3ed7-53f9-49db-b20c-d8dffedc5aee tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1257 microversion: 2.1 time: 0.153989 Aug 03 12:22:56.598088 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 538/1044] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:56 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:57.619842 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7e2741d5-4f09-4255-b6b7-cc7269447a5f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:57.620500 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7e2741d5-4f09-4255-b6b7-cc7269447a5f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:57.629273 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7e2741d5-4f09-4255-b6b7-cc7269447a5f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:57.629780 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7e2741d5-4f09-4255-b6b7-cc7269447a5f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:57.630597 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7e2741d5-4f09-4255-b6b7-cc7269447a5f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:57.631044 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7e2741d5-4f09-4255-b6b7-cc7269447a5f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:57.768204 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7e2741d5-4f09-4255-b6b7-cc7269447a5f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:57.776839 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7e2741d5-4f09-4255-b6b7-cc7269447a5f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1257 microversion: 2.1 time: 0.161558 Aug 03 12:22:57.777401 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 507/1045] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:57 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1257 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:58.797863 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-302f9418-86a1-4a28-a244-074d29aeab61 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:58.798538 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-302f9418-86a1-4a28-a244-074d29aeab61 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:58.805017 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-302f9418-86a1-4a28-a244-074d29aeab61 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:58.805476 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-302f9418-86a1-4a28-a244-074d29aeab61 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:58.806254 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-302f9418-86a1-4a28-a244-074d29aeab61 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:58.806711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-302f9418-86a1-4a28-a244-074d29aeab61 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:58.938658 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-302f9418-86a1-4a28-a244-074d29aeab61 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:22:58.946616 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-302f9418-86a1-4a28-a244-074d29aeab61 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1257 microversion: 2.1 time: 0.152665 Aug 03 12:22:58.947176 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 539/1046] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:58 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:22:59.967834 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-0096dde0-3e42-47ee-9f7a-401e542cff67 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:22:59.968489 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-0096dde0-3e42-47ee-9f7a-401e542cff67 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:22:59.975371 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0096dde0-3e42-47ee-9f7a-401e542cff67 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:59.975852 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0096dde0-3e42-47ee-9f7a-401e542cff67 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:22:59.976633 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0096dde0-3e42-47ee-9f7a-401e542cff67 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:22:59.977072 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-0096dde0-3e42-47ee-9f7a-401e542cff67 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:23:00.110539 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-0096dde0-3e42-47ee-9f7a-401e542cff67 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:23:00.118803 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-0096dde0-3e42-47ee-9f7a-401e542cff67 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1257 microversion: 2.1 time: 0.154811 Aug 03 12:23:00.119323 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 508/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:22:59 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:23:01.139371 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-61e20d85-c534-4084-83c3-8d2c5debebc4 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:23:01.140007 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-61e20d85-c534-4084-83c3-8d2c5debebc4 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:23:01.146718 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61e20d85-c534-4084-83c3-8d2c5debebc4 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:23:01.147163 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61e20d85-c534-4084-83c3-8d2c5debebc4 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:23:01.147920 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61e20d85-c534-4084-83c3-8d2c5debebc4 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:23:01.148365 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-61e20d85-c534-4084-83c3-8d2c5debebc4 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:23:01.280596 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-61e20d85-c534-4084-83c3-8d2c5debebc4 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:23:01.288349 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-61e20d85-c534-4084-83c3-8d2c5debebc4 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1257 microversion: 2.1 time: 0.152906 Aug 03 12:23:01.288919 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 540/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:23:01 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:23:01.306041 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-984f9d66-30c6-4b49-9eab-1ee3d430933a req-3b1da1a2-8b71-467d-831f-713a65fd31e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a94bdd5-88da-4ea8-b03d-198e616c13dc", "name": "network-vif-plugged", "status": "completed", "tag": "83ffe82b-8b33-4a62-a5ab-eb2342a33b9a"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:23:01.315789 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-984f9d66-30c6-4b49-9eab-1ee3d430933a req-3b1da1a2-8b71-467d-831f-713a65fd31e8 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:23:01.316237 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-984f9d66-30c6-4b49-9eab-1ee3d430933a req-3b1da1a2-8b71-467d-831f-713a65fd31e8 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:23:01.327017 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-984f9d66-30c6-4b49-9eab-1ee3d430933a req-3b1da1a2-8b71-467d-831f-713a65fd31e8 service nova] Creating event network-vif-plugged:83ffe82b-8b33-4a62-a5ab-eb2342a33b9a for instance 2a94bdd5-88da-4ea8-b03d-198e616c13dc on hv-cinder-83602 Aug 03 12:23:01.331912 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-984f9d66-30c6-4b49-9eab-1ee3d430933a req-3b1da1a2-8b71-467d-831f-713a65fd31e8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103506 Aug 03 12:23:01.332496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 509/1049] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:23:02.311443 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-5b2a8d10-efdb-44e9-b920-2b002862e658 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:23:02.312045 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-5b2a8d10-efdb-44e9-b920-2b002862e658 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:23:02.318456 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b2a8d10-efdb-44e9-b920-2b002862e658 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:23:02.318905 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b2a8d10-efdb-44e9-b920-2b002862e658 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:23:02.319655 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b2a8d10-efdb-44e9-b920-2b002862e658 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:23:02.320084 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-5b2a8d10-efdb-44e9-b920-2b002862e658 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:23:02.456194 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-5b2a8d10-efdb-44e9-b920-2b002862e658 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:23:02.463710 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-5b2a8d10-efdb-44e9-b920-2b002862e658 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1257 microversion: 2.1 time: 0.156156 Aug 03 12:23:02.464281 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 541/1050] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:23:02 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:23:03.485384 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-6a28d44f-8c9e-4a86-9094-42f8d6cbb436 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:23:03.486090 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-6a28d44f-8c9e-4a86-9094-42f8d6cbb436 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:23:03.492377 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6a28d44f-8c9e-4a86-9094-42f8d6cbb436 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:23:03.492820 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6a28d44f-8c9e-4a86-9094-42f8d6cbb436 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:23:03.493659 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6a28d44f-8c9e-4a86-9094-42f8d6cbb436 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:23:03.494017 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-6a28d44f-8c9e-4a86-9094-42f8d6cbb436 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:23:03.627144 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-6a28d44f-8c9e-4a86-9094-42f8d6cbb436 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:23:03.634728 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-6a28d44f-8c9e-4a86-9094-42f8d6cbb436 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1441 microversion: 2.1 time: 0.154058 Aug 03 12:23:03.635305 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 510/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:23:03 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1441 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:23:03.654592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-782c9419-433e-459a-b405-e8c80355e1b5 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:23:03.655207 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-782c9419-433e-459a-b405-e8c80355e1b5 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:23:03.661662 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-782c9419-433e-459a-b405-e8c80355e1b5 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:23:03.662071 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-782c9419-433e-459a-b405-e8c80355e1b5 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:23:03.662879 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-782c9419-433e-459a-b405-e8c80355e1b5 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:23:03.663298 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-782c9419-433e-459a-b405-e8c80355e1b5 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:23:03.792598 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-782c9419-433e-459a-b405-e8c80355e1b5 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:23:03.800051 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-782c9419-433e-459a-b405-e8c80355e1b5 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1441 microversion: 2.1 time: 0.149286 Aug 03 12:23:03.800609 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 542/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:23:03 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1441 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:23:05.501619 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-5496ad62-5e32-4a2a-ba8b-54faf1698fd8 req-e9e83769-3fe9-4e10-b519-7591995a376c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a94bdd5-88da-4ea8-b03d-198e616c13dc", "tag": "83ffe82b-8b33-4a62-a5ab-eb2342a33b9a"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:23:05.511965 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-5496ad62-5e32-4a2a-ba8b-54faf1698fd8 req-e9e83769-3fe9-4e10-b519-7591995a376c service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:23:05.512488 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-5496ad62-5e32-4a2a-ba8b-54faf1698fd8 req-e9e83769-3fe9-4e10-b519-7591995a376c service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:23:05.525545 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-5496ad62-5e32-4a2a-ba8b-54faf1698fd8 req-e9e83769-3fe9-4e10-b519-7591995a376c service nova] Creating event network-changed:83ffe82b-8b33-4a62-a5ab-eb2342a33b9a for instance 2a94bdd5-88da-4ea8-b03d-198e616c13dc on hv-cinder-83602 Aug 03 12:23:05.530830 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-5496ad62-5e32-4a2a-ba8b-54faf1698fd8 req-e9e83769-3fe9-4e10-b519-7591995a376c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092983 Aug 03 12:23:05.531635 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 511/1053] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:23:07.595269 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 12:23:07.595946 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Wed Aug 3 12:23:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 12:24:30.453702 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 12:24:30.454287 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Wed Aug 3 12:24:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 12:24:59.638393 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:24:59.639167 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=56 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:24:59.643947 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-28b18154-51a3-435a-8e20-688ba849c5fe tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:24:59.644486 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-28b18154-51a3-435a-8e20-688ba849c5fe tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:24:59.652272 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-28b18154-51a3-435a-8e20-688ba849c5fe tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:24:59.652724 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-28b18154-51a3-435a-8e20-688ba849c5fe tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:24:59.653487 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-28b18154-51a3-435a-8e20-688ba849c5fe tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:24:59.653935 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-28b18154-51a3-435a-8e20-688ba849c5fe tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:24:59.677300 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-28b18154-51a3-435a-8e20-688ba849c5fe tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lazy-loading 'flavor' on Instance uuid 2a94bdd5-88da-4ea8-b03d-198e616c13dc {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:24:59.744847 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: ERROR oslo.messaging._drivers.impl_rabbit [None req-28b18154-51a3-435a-8e20-688ba849c5fe tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [f9e82236-336e-46e5-b6a6-61119f8bece1] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 12:25:00.751794 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [None req-28b18154-51a3-435a-8e20-688ba849c5fe tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [f9e82236-336e-46e5-b6a6-61119f8bece1] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 48094. Aug 03 12:25:00.755083 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-28b18154-51a3-435a-8e20-688ba849c5fe tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "POST /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc/action" status: 202 len: 0 microversion: 2.1 time: 1.118491 Aug 03 12:25:00.755679 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 543/1054] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:24:59 2022] POST /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc/action => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:25:00.762183 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR oslo.messaging._drivers.impl_rabbit [-] [13cf94ee-9edf-4294-b919-bb925b483683] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 03 12:25:00.762837 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=28 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:25:00.763629 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=48 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:25:00.768253 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b64ca4df-fddc-4d3c-b5ad-d31edc8ab007 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:00.768835 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b64ca4df-fddc-4d3c-b5ad-d31edc8ab007 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:00.776496 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b64ca4df-fddc-4d3c-b5ad-d31edc8ab007 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:00.776942 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b64ca4df-fddc-4d3c-b5ad-d31edc8ab007 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:00.777720 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b64ca4df-fddc-4d3c-b5ad-d31edc8ab007 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:00.778156 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b64ca4df-fddc-4d3c-b5ad-d31edc8ab007 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:00.927483 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b64ca4df-fddc-4d3c-b5ad-d31edc8ab007 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:00.935651 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b64ca4df-fddc-4d3c-b5ad-d31edc8ab007 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1565 microversion: 2.1 time: 0.175343 Aug 03 12:25:00.936261 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 512/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:00 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:01.958793 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-0d4be5c0-7c2f-4d19-8e44-e7da99721236 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:01.959675 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-0d4be5c0-7c2f-4d19-8e44-e7da99721236 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:01.967058 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0d4be5c0-7c2f-4d19-8e44-e7da99721236 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:01.967507 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0d4be5c0-7c2f-4d19-8e44-e7da99721236 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:01.968292 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0d4be5c0-7c2f-4d19-8e44-e7da99721236 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:01.968735 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-0d4be5c0-7c2f-4d19-8e44-e7da99721236 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:02.104153 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-0d4be5c0-7c2f-4d19-8e44-e7da99721236 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:02.112312 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-0d4be5c0-7c2f-4d19-8e44-e7da99721236 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1565 microversion: 2.1 time: 0.158364 Aug 03 12:25:02.112879 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 544/1056] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:01 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:03.133200 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-7f54b07e-0686-441c-bf8e-67ccda04ae25 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:03.133818 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-7f54b07e-0686-441c-bf8e-67ccda04ae25 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:03.143238 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7f54b07e-0686-441c-bf8e-67ccda04ae25 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:03.143691 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7f54b07e-0686-441c-bf8e-67ccda04ae25 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:03.144448 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7f54b07e-0686-441c-bf8e-67ccda04ae25 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:03.144878 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-7f54b07e-0686-441c-bf8e-67ccda04ae25 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:03.150774 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO oslo.messaging._drivers.impl_rabbit [-] [13cf94ee-9edf-4294-b919-bb925b483683] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 48106. Aug 03 12:25:03.279643 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-7f54b07e-0686-441c-bf8e-67ccda04ae25 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:03.287339 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-7f54b07e-0686-441c-bf8e-67ccda04ae25 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1565 microversion: 2.1 time: 0.158072 Aug 03 12:25:03.287914 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 513/1057] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:03 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:04.308867 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-e034dbfe-6d99-491c-9070-be623f22608b tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:04.309485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-e034dbfe-6d99-491c-9070-be623f22608b tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:04.316137 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e034dbfe-6d99-491c-9070-be623f22608b tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:04.316595 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e034dbfe-6d99-491c-9070-be623f22608b tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:04.317363 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e034dbfe-6d99-491c-9070-be623f22608b tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:04.317805 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-e034dbfe-6d99-491c-9070-be623f22608b tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:04.448591 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-e034dbfe-6d99-491c-9070-be623f22608b tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:04.456564 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-e034dbfe-6d99-491c-9070-be623f22608b tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1565 microversion: 2.1 time: 0.151693 Aug 03 12:25:04.457146 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 545/1058] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:04 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:05.478599 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-f2d58ab4-6a7e-4512-9e98-e1cfe9104da7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:05.479353 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-f2d58ab4-6a7e-4512-9e98-e1cfe9104da7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:05.486506 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f2d58ab4-6a7e-4512-9e98-e1cfe9104da7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:05.486962 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f2d58ab4-6a7e-4512-9e98-e1cfe9104da7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:05.487737 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f2d58ab4-6a7e-4512-9e98-e1cfe9104da7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:05.488180 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-f2d58ab4-6a7e-4512-9e98-e1cfe9104da7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:05.621152 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-f2d58ab4-6a7e-4512-9e98-e1cfe9104da7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:05.629408 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-f2d58ab4-6a7e-4512-9e98-e1cfe9104da7 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1565 microversion: 2.1 time: 0.154825 Aug 03 12:25:05.629980 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 514/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:05 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:06.650816 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-682f0800-f345-4eb1-91b3-fc486b080cca tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:06.651422 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-682f0800-f345-4eb1-91b3-fc486b080cca tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:06.657871 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-682f0800-f345-4eb1-91b3-fc486b080cca tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:06.658342 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-682f0800-f345-4eb1-91b3-fc486b080cca tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:06.659126 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-682f0800-f345-4eb1-91b3-fc486b080cca tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:06.659552 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-682f0800-f345-4eb1-91b3-fc486b080cca tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:06.789906 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-682f0800-f345-4eb1-91b3-fc486b080cca tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:06.797396 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-682f0800-f345-4eb1-91b3-fc486b080cca tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1565 microversion: 2.1 time: 0.150850 Aug 03 12:25:06.797946 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 546/1060] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:06 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:07.818537 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-52d50304-b5fb-4d12-86c8-d5fda20ce962 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:07.819156 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-52d50304-b5fb-4d12-86c8-d5fda20ce962 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:07.825722 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-52d50304-b5fb-4d12-86c8-d5fda20ce962 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:07.826175 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-52d50304-b5fb-4d12-86c8-d5fda20ce962 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:07.826975 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-52d50304-b5fb-4d12-86c8-d5fda20ce962 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:07.827418 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-52d50304-b5fb-4d12-86c8-d5fda20ce962 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:07.961879 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-52d50304-b5fb-4d12-86c8-d5fda20ce962 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:07.969444 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-52d50304-b5fb-4d12-86c8-d5fda20ce962 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1565 microversion: 2.1 time: 0.154824 Aug 03 12:25:07.970011 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 515/1061] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:07 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:08.990322 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c36ffb1c-baa9-4be2-ae57-d084175e8d2c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:08.990917 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c36ffb1c-baa9-4be2-ae57-d084175e8d2c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:08.997406 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c36ffb1c-baa9-4be2-ae57-d084175e8d2c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:08.997857 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c36ffb1c-baa9-4be2-ae57-d084175e8d2c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:08.998668 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c36ffb1c-baa9-4be2-ae57-d084175e8d2c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:08.999105 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c36ffb1c-baa9-4be2-ae57-d084175e8d2c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:09.131649 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c36ffb1c-baa9-4be2-ae57-d084175e8d2c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:09.139124 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c36ffb1c-baa9-4be2-ae57-d084175e8d2c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1565 microversion: 2.1 time: 0.152726 Aug 03 12:25:09.139690 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 547/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:08 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:10.160398 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1e28067b-5d39-42b2-b7f2-e07095c1b65f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:10.161016 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1e28067b-5d39-42b2-b7f2-e07095c1b65f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:10.167542 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1e28067b-5d39-42b2-b7f2-e07095c1b65f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:10.167999 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1e28067b-5d39-42b2-b7f2-e07095c1b65f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:10.168766 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1e28067b-5d39-42b2-b7f2-e07095c1b65f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:10.169208 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1e28067b-5d39-42b2-b7f2-e07095c1b65f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:10.299641 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-1e28067b-5d39-42b2-b7f2-e07095c1b65f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:10.307213 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1e28067b-5d39-42b2-b7f2-e07095c1b65f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1565 microversion: 2.1 time: 0.151294 Aug 03 12:25:10.307788 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 516/1063] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:10 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:11.328706 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4037fdcf-633e-4c5e-94ce-58e56a4a434d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:11.329325 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4037fdcf-633e-4c5e-94ce-58e56a4a434d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:11.336529 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4037fdcf-633e-4c5e-94ce-58e56a4a434d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:11.336984 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4037fdcf-633e-4c5e-94ce-58e56a4a434d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:11.337750 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4037fdcf-633e-4c5e-94ce-58e56a4a434d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:11.338186 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4037fdcf-633e-4c5e-94ce-58e56a4a434d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:11.473338 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4037fdcf-633e-4c5e-94ce-58e56a4a434d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:11.481151 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4037fdcf-633e-4c5e-94ce-58e56a4a434d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1565 microversion: 2.1 time: 0.156355 Aug 03 12:25:11.481736 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 548/1064] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:11 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:12.502683 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5497ac6b-50e1-4172-83dc-604ea548fb6a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:12.503303 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5497ac6b-50e1-4172-83dc-604ea548fb6a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:12.509941 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5497ac6b-50e1-4172-83dc-604ea548fb6a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:12.510395 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5497ac6b-50e1-4172-83dc-604ea548fb6a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:12.511198 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5497ac6b-50e1-4172-83dc-604ea548fb6a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:12.511640 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5497ac6b-50e1-4172-83dc-604ea548fb6a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:12.643248 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5497ac6b-50e1-4172-83dc-604ea548fb6a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:12.651364 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5497ac6b-50e1-4172-83dc-604ea548fb6a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1565 microversion: 2.1 time: 0.152810 Aug 03 12:25:12.651941 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 517/1065] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:12 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:13.673921 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-efd85d65-50d9-477e-a211-e44b0e9112ec tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:13.674592 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-efd85d65-50d9-477e-a211-e44b0e9112ec tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:13.681132 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-efd85d65-50d9-477e-a211-e44b0e9112ec tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:13.681622 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-efd85d65-50d9-477e-a211-e44b0e9112ec tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:13.682340 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-efd85d65-50d9-477e-a211-e44b0e9112ec tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:13.682813 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-efd85d65-50d9-477e-a211-e44b0e9112ec tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:14.067380 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-efd85d65-50d9-477e-a211-e44b0e9112ec tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:14.074922 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-efd85d65-50d9-477e-a211-e44b0e9112ec tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1506 microversion: 2.1 time: 0.405735 Aug 03 12:25:14.075493 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 549/1066] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:13 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:14.095456 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-1ad4e531-00e8-4a2a-bcf5-0feaf149f13f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:25:14.096064 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1ad4e531-00e8-4a2a-bcf5-0feaf149f13f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:14.102581 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1ad4e531-00e8-4a2a-bcf5-0feaf149f13f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:14.103033 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1ad4e531-00e8-4a2a-bcf5-0feaf149f13f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:14.103800 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1ad4e531-00e8-4a2a-bcf5-0feaf149f13f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:14.104237 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-1ad4e531-00e8-4a2a-bcf5-0feaf149f13f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:14.189536 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-1ad4e531-00e8-4a2a-bcf5-0feaf149f13f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117911) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 12:25:14.253874 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-1ad4e531-00e8-4a2a-bcf5-0feaf149f13f tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "POST /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc/action" status: 202 len: 0 microversion: 2.1 time: 0.162824 Aug 03 12:25:14.254503 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 518/1067] 10.222.0.17 () {60 vars in 1278 bytes} [Wed Aug 3 12:25:14 2022] POST /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:25:14.263037 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-db4a88d6-e724-42cd-b14a-600aeec5f895 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:14.263658 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-db4a88d6-e724-42cd-b14a-600aeec5f895 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:14.270186 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-db4a88d6-e724-42cd-b14a-600aeec5f895 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:14.270687 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-db4a88d6-e724-42cd-b14a-600aeec5f895 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:14.271466 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-db4a88d6-e724-42cd-b14a-600aeec5f895 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:14.272360 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-db4a88d6-e724-42cd-b14a-600aeec5f895 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:14.413482 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-db4a88d6-e724-42cd-b14a-600aeec5f895 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:14.421313 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-db4a88d6-e724-42cd-b14a-600aeec5f895 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1514 microversion: 2.1 time: 0.162498 Aug 03 12:25:14.422485 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 550/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:14 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:25:15.443654 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-c8794b83-e8aa-416d-841b-c3c3d4a5f951 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:15.444272 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-c8794b83-e8aa-416d-841b-c3c3d4a5f951 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:15.450402 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c8794b83-e8aa-416d-841b-c3c3d4a5f951 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:15.450892 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c8794b83-e8aa-416d-841b-c3c3d4a5f951 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:15.451657 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c8794b83-e8aa-416d-841b-c3c3d4a5f951 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:15.452097 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-c8794b83-e8aa-416d-841b-c3c3d4a5f951 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:15.585260 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-c8794b83-e8aa-416d-841b-c3c3d4a5f951 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:15.592849 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-c8794b83-e8aa-416d-841b-c3c3d4a5f951 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1572 microversion: 2.1 time: 0.154230 Aug 03 12:25:15.593441 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 519/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:15 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:16.615798 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-98b827e8-0a4d-43fa-b0fe-cf5162103932 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:16.616419 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-98b827e8-0a4d-43fa-b0fe-cf5162103932 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:16.622894 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-98b827e8-0a4d-43fa-b0fe-cf5162103932 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:16.623347 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-98b827e8-0a4d-43fa-b0fe-cf5162103932 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:16.624111 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-98b827e8-0a4d-43fa-b0fe-cf5162103932 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:16.624549 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-98b827e8-0a4d-43fa-b0fe-cf5162103932 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:16.757109 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-98b827e8-0a4d-43fa-b0fe-cf5162103932 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:16.764618 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-98b827e8-0a4d-43fa-b0fe-cf5162103932 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1572 microversion: 2.1 time: 0.153850 Aug 03 12:25:16.765194 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 551/1070] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:16 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:17.785712 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-5c42dce6-c742-4a06-82cb-66eb6043f07e tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:17.786328 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-5c42dce6-c742-4a06-82cb-66eb6043f07e tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:17.792809 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c42dce6-c742-4a06-82cb-66eb6043f07e tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:17.793249 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c42dce6-c742-4a06-82cb-66eb6043f07e tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:17.794008 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c42dce6-c742-4a06-82cb-66eb6043f07e tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:17.794458 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-5c42dce6-c742-4a06-82cb-66eb6043f07e tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:17.817439 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [req-e195068f-e5bb-4770-938c-28730beb0dd7 req-df68c136-a7da-453e-b5c1-093f24a97cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a94bdd5-88da-4ea8-b03d-198e616c13dc", "name": "network-vif-unplugged", "status": "completed", "tag": "83ffe82b-8b33-4a62-a5ab-eb2342a33b9a"}]} {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:25:17.830297 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-e195068f-e5bb-4770-938c-28730beb0dd7 req-df68c136-a7da-453e-b5c1-093f24a97cc7 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:17.831129 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [req-e195068f-e5bb-4770-938c-28730beb0dd7 req-df68c136-a7da-453e-b5c1-093f24a97cc7 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:17.842928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.compute.server_external_events [req-e195068f-e5bb-4770-938c-28730beb0dd7 req-df68c136-a7da-453e-b5c1-093f24a97cc7 service nova] Creating event network-vif-unplugged:83ffe82b-8b33-4a62-a5ab-eb2342a33b9a for instance 2a94bdd5-88da-4ea8-b03d-198e616c13dc on hv-cinder-83602 Aug 03 12:25:17.848695 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [req-e195068f-e5bb-4770-938c-28730beb0dd7 req-df68c136-a7da-453e-b5c1-093f24a97cc7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035708 Aug 03 12:25:17.849303 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 552/1071] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:25:17.938025 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-5c42dce6-c742-4a06-82cb-66eb6043f07e tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:17.946152 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-5c42dce6-c742-4a06-82cb-66eb6043f07e tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1572 microversion: 2.1 time: 0.164321 Aug 03 12:25:17.946830 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 520/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:17 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1572 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:18.968206 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b0338ed7-a96c-4eaf-b4c5-79a8475f0c8c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:18.968913 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-b0338ed7-a96c-4eaf-b4c5-79a8475f0c8c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:18.975617 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b0338ed7-a96c-4eaf-b4c5-79a8475f0c8c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:18.976072 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b0338ed7-a96c-4eaf-b4c5-79a8475f0c8c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:18.976837 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b0338ed7-a96c-4eaf-b4c5-79a8475f0c8c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:18.977278 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-b0338ed7-a96c-4eaf-b4c5-79a8475f0c8c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:19.120210 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-b0338ed7-a96c-4eaf-b4c5-79a8475f0c8c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:19.128484 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b0338ed7-a96c-4eaf-b4c5-79a8475f0c8c tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1572 microversion: 2.1 time: 0.164552 Aug 03 12:25:19.129048 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 553/1073] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:18 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1572 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:20.149896 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-2e779fc1-442c-4a12-a6ee-c0f6e43dbc5d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:20.150468 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-2e779fc1-442c-4a12-a6ee-c0f6e43dbc5d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:20.157227 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2e779fc1-442c-4a12-a6ee-c0f6e43dbc5d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:20.157679 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2e779fc1-442c-4a12-a6ee-c0f6e43dbc5d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:20.158460 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2e779fc1-442c-4a12-a6ee-c0f6e43dbc5d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:20.158974 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-2e779fc1-442c-4a12-a6ee-c0f6e43dbc5d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:20.293559 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-2e779fc1-442c-4a12-a6ee-c0f6e43dbc5d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:20.301961 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-2e779fc1-442c-4a12-a6ee-c0f6e43dbc5d tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1572 microversion: 2.1 time: 0.156265 Aug 03 12:25:20.302545 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 521/1074] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:20 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:21.323746 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-4aec311e-a17d-4253-9e5f-b0ef1f0e5f42 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:21.324356 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-4aec311e-a17d-4253-9e5f-b0ef1f0e5f42 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:21.330470 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4aec311e-a17d-4253-9e5f-b0ef1f0e5f42 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:21.330928 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4aec311e-a17d-4253-9e5f-b0ef1f0e5f42 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:21.331687 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4aec311e-a17d-4253-9e5f-b0ef1f0e5f42 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:21.332123 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-4aec311e-a17d-4253-9e5f-b0ef1f0e5f42 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:21.465931 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-4aec311e-a17d-4253-9e5f-b0ef1f0e5f42 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:21.474064 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-4aec311e-a17d-4253-9e5f-b0ef1f0e5f42 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1572 microversion: 2.1 time: 0.154400 Aug 03 12:25:21.474659 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 554/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:21 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:25:22.501435 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-b8036e22-c971-4c58-a2c3-017b1d26c454 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:22.502054 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-b8036e22-c971-4c58-a2c3-017b1d26c454 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:22.508622 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b8036e22-c971-4c58-a2c3-017b1d26c454 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:22.509075 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b8036e22-c971-4c58-a2c3-017b1d26c454 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:22.509848 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b8036e22-c971-4c58-a2c3-017b1d26c454 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:22.510289 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-b8036e22-c971-4c58-a2c3-017b1d26c454 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:22.644949 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-b8036e22-c971-4c58-a2c3-017b1d26c454 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:22.652764 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-b8036e22-c971-4c58-a2c3-017b1d26c454 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1572 microversion: 2.1 time: 0.156053 Aug 03 12:25:22.653331 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 522/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:22 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:23.674939 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-c7870602-1b74-4621-9f3a-456f018dd4cd tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:25:23.675548 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-c7870602-1b74-4621-9f3a-456f018dd4cd tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:25:23.681998 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7870602-1b74-4621-9f3a-456f018dd4cd tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:23.682474 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7870602-1b74-4621-9f3a-456f018dd4cd tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:23.683238 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7870602-1b74-4621-9f3a-456f018dd4cd tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:23.683674 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-c7870602-1b74-4621-9f3a-456f018dd4cd tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:23.818056 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-c7870602-1b74-4621-9f3a-456f018dd4cd tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:25:23.826048 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-c7870602-1b74-4621-9f3a-456f018dd4cd tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1559 microversion: 2.1 time: 0.155634 Aug 03 12:25:23.826675 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 555/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:25:23 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:25:25.891570 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-0e55e218-ddd7-4c17-a4ac-4df6ca052b05 req-7eab6bd1-e1da-43d8-9e0c-6568fcddecd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a94bdd5-88da-4ea8-b03d-198e616c13dc", "name": "network-vif-plugged", "status": "completed", "tag": "83ffe82b-8b33-4a62-a5ab-eb2342a33b9a"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:25:25.903206 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-0e55e218-ddd7-4c17-a4ac-4df6ca052b05 req-7eab6bd1-e1da-43d8-9e0c-6568fcddecd2 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:25:25.903749 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-0e55e218-ddd7-4c17-a4ac-4df6ca052b05 req-7eab6bd1-e1da-43d8-9e0c-6568fcddecd2 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:25:25.917882 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-0e55e218-ddd7-4c17-a4ac-4df6ca052b05 req-7eab6bd1-e1da-43d8-9e0c-6568fcddecd2 service nova] Creating event network-vif-plugged:83ffe82b-8b33-4a62-a5ab-eb2342a33b9a for instance 2a94bdd5-88da-4ea8-b03d-198e616c13dc on hv-cinder-83602 Aug 03 12:25:25.923189 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-0e55e218-ddd7-4c17-a4ac-4df6ca052b05 req-7eab6bd1-e1da-43d8-9e0c-6568fcddecd2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035607 Aug 03 12:25:25.924861 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 523/1078] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:26:37.239948 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_api:SELECT=26 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:26:37.241174 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG dbcounter [-] [117910] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:26:37.245943 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-fd4f41e5-3ac8-46b2-8ea5-a84ce8cf71a9 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:26:37.246158 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-0a7d7e91-47a0-4d7b-a173-9e34a3b78bf7 req-47229f7a-f6df-408f-a3a6-ed99dc2f20dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a94bdd5-88da-4ea8-b03d-198e616c13dc", "tag": "83ffe82b-8b33-4a62-a5ab-eb2342a33b9a"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:26:37.246609 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fd4f41e5-3ac8-46b2-8ea5-a84ce8cf71a9 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:26:37.254281 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fd4f41e5-3ac8-46b2-8ea5-a84ce8cf71a9 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:26:37.254854 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fd4f41e5-3ac8-46b2-8ea5-a84ce8cf71a9 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:26:37.255225 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:26:37.255783 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fd4f41e5-3ac8-46b2-8ea5-a84ce8cf71a9 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:26:37.255904 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG dbcounter [-] [117911] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117911) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:26:37.256321 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-fd4f41e5-3ac8-46b2-8ea5-a84ce8cf71a9 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:26:37.259493 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-0a7d7e91-47a0-4d7b-a173-9e34a3b78bf7 req-47229f7a-f6df-408f-a3a6-ed99dc2f20dc service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:26:37.260129 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-0a7d7e91-47a0-4d7b-a173-9e34a3b78bf7 req-47229f7a-f6df-408f-a3a6-ed99dc2f20dc service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:26:37.277245 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-0a7d7e91-47a0-4d7b-a173-9e34a3b78bf7 req-47229f7a-f6df-408f-a3a6-ed99dc2f20dc service nova] Creating event network-changed:83ffe82b-8b33-4a62-a5ab-eb2342a33b9a for instance 2a94bdd5-88da-4ea8-b03d-198e616c13dc on hv-cinder-83602 Aug 03 12:26:37.283253 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-0a7d7e91-47a0-4d7b-a173-9e34a3b78bf7 req-47229f7a-f6df-408f-a3a6-ed99dc2f20dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042631 Aug 03 12:26:37.284094 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 524/1079] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 12:26:37.284840 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-fd4f41e5-3ac8-46b2-8ea5-a84ce8cf71a9 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Going to try to terminate instance {{(pid=117910) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 12:26:37.379303 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-fd4f41e5-3ac8-46b2-8ea5-a84ce8cf71a9 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 204 len: 0 microversion: 2.1 time: 0.141062 Aug 03 12:26:37.381906 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 556/1080] 10.222.0.17 () {58 vars in 1239 bytes} [Wed Aug 3 12:26:37 2022] DELETE /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 12:26:37.391444 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-753d402b-0ae7-46be-821c-36b03775a51a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:26:37.392156 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-753d402b-0ae7-46be-821c-36b03775a51a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:26:37.401279 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-753d402b-0ae7-46be-821c-36b03775a51a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:26:37.401726 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-753d402b-0ae7-46be-821c-36b03775a51a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:26:37.402538 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-753d402b-0ae7-46be-821c-36b03775a51a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:26:37.402981 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-753d402b-0ae7-46be-821c-36b03775a51a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:26:37.604039 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.policy [None req-753d402b-0ae7-46be-821c-36b03775a51a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117911) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:26:37.612485 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-753d402b-0ae7-46be-821c-36b03775a51a tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1565 microversion: 2.1 time: 0.225337 Aug 03 12:26:37.612985 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 525/1081] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:26:37 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1565 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:26:38.634303 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-005f9417-da5a-457e-ac16-a5e6055131fa tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:26:38.635167 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-005f9417-da5a-457e-ac16-a5e6055131fa tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:26:38.642176 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-005f9417-da5a-457e-ac16-a5e6055131fa tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:26:38.642673 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-005f9417-da5a-457e-ac16-a5e6055131fa tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:26:38.643450 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-005f9417-da5a-457e-ac16-a5e6055131fa tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:26:38.643896 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-005f9417-da5a-457e-ac16-a5e6055131fa tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:26:38.827212 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-005f9417-da5a-457e-ac16-a5e6055131fa tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:26:38.834843 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-005f9417-da5a-457e-ac16-a5e6055131fa tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1565 microversion: 2.1 time: 0.205122 Aug 03 12:26:38.835425 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 557/1082] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:26:38 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1565 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 12:26:39.344060 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [req-57bd63e4-e5c2-45a6-bf7d-101c28af982d req-dc4e385a-6578-498f-ae38-50840b6257d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a94bdd5-88da-4ea8-b03d-198e616c13dc", "name": "network-vif-deleted", "tag": "83ffe82b-8b33-4a62-a5ab-eb2342a33b9a"}]} {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 12:26:39.354977 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-57bd63e4-e5c2-45a6-bf7d-101c28af982d req-dc4e385a-6578-498f-ae38-50840b6257d0 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:26:39.355429 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [req-57bd63e4-e5c2-45a6-bf7d-101c28af982d req-dc4e385a-6578-498f-ae38-50840b6257d0 service nova] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:26:39.368256 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.compute.server_external_events [req-57bd63e4-e5c2-45a6-bf7d-101c28af982d req-dc4e385a-6578-498f-ae38-50840b6257d0 service nova] Creating event network-vif-deleted:83ffe82b-8b33-4a62-a5ab-eb2342a33b9a for instance 2a94bdd5-88da-4ea8-b03d-198e616c13dc on hv-cinder-83602 Aug 03 12:26:39.373754 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [req-57bd63e4-e5c2-45a6-bf7d-101c28af982d req-dc4e385a-6578-498f-ae38-50840b6257d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033369 Aug 03 12:26:39.374388 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 526/1083] 10.222.0.17 () {64 vars in 1317 bytes} [Wed Aug 3 12:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 12:26:39.858029 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-8568030c-ca18-41bf-8941-fdd4b7133019 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:26:39.858749 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.compute.api [None req-8568030c-ca18-41bf-8941-fdd4b7133019 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117910) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:26:39.865387 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8568030c-ca18-41bf-8941-fdd4b7133019 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:26:39.865843 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8568030c-ca18-41bf-8941-fdd4b7133019 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:26:39.866711 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8568030c-ca18-41bf-8941-fdd4b7133019 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:26:39.867896 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8568030c-ca18-41bf-8941-fdd4b7133019 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:26:39.899960 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8568030c-ca18-41bf-8941-fdd4b7133019 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:26:39.900431 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG oslo_concurrency.lockutils [None req-8568030c-ca18-41bf-8941-fdd4b7133019 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:26:39.900882 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.objects.instance [None req-8568030c-ca18-41bf-8941-fdd4b7133019 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lazy-loading 'fault' on Instance uuid 2a94bdd5-88da-4ea8-b03d-198e616c13dc {{(pid=117910) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 12:26:39.941635 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.policy [None req-8568030c-ca18-41bf-8941-fdd4b7133019 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bdcd9a30fe4463399960e4a4cc151fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1199da325f44f4a86d9c7f0e3240e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117910) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 12:26:39.949658 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-8568030c-ca18-41bf-8941-fdd4b7133019 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 200 len: 1224 microversion: 2.1 time: 0.095854 Aug 03 12:26:39.950316 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 558/1084] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:26:39 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 12:26:40.973946 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-569c1a4f-3366-4ddd-beae-7f718b7a0f49 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '>' {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:26:40.974675 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.compute.api [None req-569c1a4f-3366-4ddd-beae-7f718b7a0f49 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] [instance: 2a94bdd5-88da-4ea8-b03d-198e616c13dc] Fetching instance by UUID {{(pid=117911) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 12:26:40.981635 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-569c1a4f-3366-4ddd-beae-7f718b7a0f49 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:26:40.982086 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-569c1a4f-3366-4ddd-beae-7f718b7a0f49 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:26:40.982899 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-569c1a4f-3366-4ddd-beae-7f718b7a0f49 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 12:26:40.983338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG oslo_concurrency.lockutils [None req-569c1a4f-3366-4ddd-beae-7f718b7a0f49 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Lock "b78e12ae-4961-43a7-b06c-67318250b51a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117911) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 12:26:40.997261 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.wsgi [None req-569c1a4f-3366-4ddd-beae-7f718b7a0f49 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] HTTP exception thrown: Instance 2a94bdd5-88da-4ea8-b03d-198e616c13dc could not be found. Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-569c1a4f-3366-4ddd-beae-7f718b7a0f49 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Request method failure captured: Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: request: GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc HTTP/1.1 Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept: application/json Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Accept-Encoding: identity Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Connection: close Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Length: 0 Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Content-Type: application/json Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Host: 10.222.0.17 Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Openstack-System-Scope: None Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: User-Agent: python-urllib3/1.26.10 Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Auth-Token: gAAAAABi6mh9Jw53ehFPDK26QVYr1PCMfWlu62K0F_Tluvu8_U5stZjdE1QPPm7V6L4kY1YflO6nDV2dOOqqlvS114fW2Pw80av3IVqbibcIGK0PHap_N6qKFSy_l5AobNnrPjKkbGwf8qnmAPk44l3hEZuveaKbxt1-Z2JFR9qjKL439B5aWdU Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Id: None Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Domain-Name: None Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Identity-Status: Confirmed Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Is-Admin-Project: True Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Id: default Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Domain-Name: Default Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Id: b1199da325f44f4a86d9c7f0e3240e39 Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Project-Name: tempest-TestShelveInstance-1240478521 Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Role: reader,member Aug 03 12:26:40.998934 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Roles: reader,member Aug 03 12:26:41.000648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b1199da325f44f4a86d9c7f0e3240e39", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b1199da325f44f4a86d9c7f0e3240e39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b1199da325f44f4a86d9c7f0e3240e39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b1199da325f44f4a86d9c7f0e3240e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] Aug 03 12:26:41.000648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant: tempest-TestShelveInstance-1240478521 Aug 03 12:26:41.000648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Id: b1199da325f44f4a86d9c7f0e3240e39 Aug 03 12:26:41.000648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-Tenant-Name: tempest-TestShelveInstance-1240478521 Aug 03 12:26:41.000648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User: tempest-TestShelveInstance-1240478521-project Aug 03 12:26:41.000648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Id: default Aug 03 12:26:41.000648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Domain-Name: Default Aug 03 12:26:41.000648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Id: 7bdcd9a30fe4463399960e4a4cc151fd Aug 03 12:26:41.000648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: X-User-Name: tempest-TestShelveInstance-1240478521-project Aug 03 12:26:41.000648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: method: > Aug 03 12:26:41.000648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: exception: Instance 2a94bdd5-88da-4ea8-b03d-198e616c13dc could not be found. Aug 03 12:26:41.000648 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: action_args: {'id': '2a94bdd5-88da-4ea8-b03d-198e616c13dc'} Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: {{(pid=117911) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a94bdd5-88da-4ea8-b03d-198e616c13dc could not be found. Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 12:26:41.001677 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a94bdd5-88da-4ea8-b03d-198e616c13dc could not be found. Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a94bdd5-88da-4ea8-b03d-198e616c13dc could not be found. Aug 03 12:26:41.003338 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: ERROR nova.api.openstack.wsgi Aug 03 12:26:41.004781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: DEBUG nova.api.openstack.wsgi [None req-569c1a4f-3366-4ddd-beae-7f718b7a0f49 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Returning 404 to user: Instance 2a94bdd5-88da-4ea8-b03d-198e616c13dc could not be found. {{(pid=117911) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 12:26:41.004781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO nova.api.openstack.requestlog [None req-569c1a4f-3366-4ddd-beae-7f718b7a0f49 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc" status: 404 len: 111 microversion: 2.1 time: 0.031238 Aug 03 12:26:41.004781 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: [pid: 117911|app: 0|req: 527/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Wed Aug 3 12:26:40 2022] GET /compute/v2.1/servers/2a94bdd5-88da-4ea8-b03d-198e616c13dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 12:26:41.169228 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: DEBUG nova.api.openstack.wsgi [None req-b2238007-f564-425e-b4ed-ed3e336f0a36 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] Calling method '.version_select at 0x7f14d6fcfca0>' {{(pid=117910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 12:26:41.192470 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO nova.api.openstack.requestlog [None req-b2238007-f564-425e-b4ed-ed3e336f0a36 tempest-TestShelveInstance-1240478521 tempest-TestShelveInstance-1240478521-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1765847360" status: 202 len: 0 microversion: 2.1 time: 0.027424 Aug 03 12:26:41.193040 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: [pid: 117910|app: 0|req: 559/1086] 10.222.0.17 () {58 vars in 1254 bytes} [Wed Aug 3 12:26:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1765847360 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 12:27:55.045099 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 12:27:55.045776 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Wed Aug 3 12:27:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 12:28:04.155018 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 12:28:04.155610 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Wed Aug 3 12:28:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 12:28:07.605606 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 12:28:07.605606 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Wed Aug 3 12:28:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 12:29:30.464840 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 12:29:30.465448 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Wed Aug 3 12:29:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 12:31:15.053406 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 12:31:15.054093 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Wed Aug 3 12:31:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 12:31:24.163182 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 12:31:24.163652 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Wed Aug 3 12:31:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 12:31:27.614406 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 12:31:27.614952 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Wed Aug 3 12:31:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 12:31:44.100857 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 12:31:44.101436 dv-cinder-836027-3-iscsi devstack@n-api.service[117911]: Wed Aug 3 12:31:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 12:31:49.837310 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 12:31:49.837895 dv-cinder-836027-3-iscsi devstack@n-api.service[117910]: Wed Aug 3 12:31:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!